-- Logs begin at Wed 2022-08-24 05:04:47 UTC, end at Wed 2022-08-24 06:07:03 UTC. -- Aug 24 05:37:34.504196 dv-cinder-854268-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 05:37:34.513337 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 05:37:34 2022] *** Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: nodename: dv-cinder-854268-1-iscsi Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: machine: x86_64 Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: clock source: unix Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: pcre jit disabled Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: detected number of CPU cores: 4 Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: current working directory: / Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: detected binary path: /usr/bin/uwsgi-core Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: your processes number limit is 47680 Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: your memory page size is 4096 bytes Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: detected max file descriptor number: 2048 Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: lock engine: pthread robust mutexes Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: thunder lock: enabled Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 05:37:34.515957 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 05:37:34.554544 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: Python main interpreter initialized at 0x558cf768e9c0 Aug 24 05:37:34.554544 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: python threads support enabled Aug 24 05:37:34.554544 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: your server socket listen backlog is limited to 100 connections Aug 24 05:37:34.554544 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: your mercy for graceful operations on workers is 90 seconds Aug 24 05:37:34.554867 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 05:37:34.554931 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: *** Operational MODE: preforking *** Aug 24 05:37:34.555161 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: *** uWSGI is running in multiple interpreter mode *** Aug 24 05:37:34.555161 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: spawned uWSGI master process (pid: 112169) Aug 24 05:37:34.555360 dv-cinder-854268-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 05:37:34.556458 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: spawned uWSGI worker 1 (pid: 112170, cores: 1) Aug 24 05:37:34.556458 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: spawned uWSGI worker 2 (pid: 112171, cores: 1) Aug 24 05:37:34.556458 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 05:37:35.214583 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:37:35.215504 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:37:36.300915 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:37:36.300915 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: from cryptography.utils import int_from_bytes Aug 24 05:37:36.301481 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:37:36.301481 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: from cryptography.utils import int_from_bytes Aug 24 05:37:36.304819 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:37:36.304819 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: from cryptography.utils import int_from_bytes Aug 24 05:37:36.305250 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:37:36.305250 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: from cryptography.utils import int_from_bytes Aug 24 05:37:38.802167 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:37:38.802833 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:37:38.802942 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:37:38.803273 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:37:38.803345 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:37:38.803420 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:37:38.803488 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:37:38.803561 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:37:38.803773 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:37:38.803872 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.804020 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:37:38.804169 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.804403 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.804512 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.804727 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.804822 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.805047 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.805133 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.805364 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.805451 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.805709 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.805797 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806020 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806122 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806338 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806429 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806595 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806682 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806902 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.806997 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.807222 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.807360 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-1-iscsi {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.807534 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.807638 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.807834 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.807928 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-1-iscsi {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.808138 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.808230 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.808448 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.808539 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.808746 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.808845 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.809060 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.809149 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.809363 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.809452 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.809705 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.809883 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.809991 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.810324 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.810478 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.810613 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.810790 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.810906 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.811186 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.811322 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.811473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.811570 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.811716 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.811847 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.812027 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.812121 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.812335 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.812437 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.812654 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.812767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.812958 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.813046 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.813278 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.813361 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-1-iscsi {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.813603 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.813734 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.814007 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.814101 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-1-iscsi {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.814306 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.814419 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.814609 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.814714 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.814915 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.815035 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.815297 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.815397 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.815603 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.815718 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.815911 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.816097 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.816292 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.816404 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.816539 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.816761 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.816863 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.817075 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.817189 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.817396 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.817508 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.817746 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.817833 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.818045 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.818142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.818351 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.818437 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.818656 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.818741 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.818972 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.819067 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.819276 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.819370 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.819576 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.819679 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.819823 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.819910 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.820123 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.820208 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.820431 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.820524 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.820743 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.820828 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821059 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821153 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821305 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821400 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821551 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821681 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821873 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.821971 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.822187 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.822280 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.822489 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.822582 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.822793 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.822900 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.823090 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.823176 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.823390 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.823476 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.823690 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.823789 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.823988 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.824082 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.824288 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.824374 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.824586 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.824685 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.824889 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.824983 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.825196 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.825281 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.825508 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.825628 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.825834 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.825919 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.826147 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.826232 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.826466 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.826566 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.826772 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.826857 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.827075 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.827168 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.827396 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.827540 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.827706 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.827800 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.828009 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.828095 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.828322 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.828410 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.828635 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.828728 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.828935 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.829019 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.829243 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.829341 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.829544 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.829647 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.829870 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.829959 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.830189 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.830276 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.830486 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.830571 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.830734 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.830830 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.831031 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.831117 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.831331 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.831415 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.831638 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.831743 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.831939 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.832030 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.832751 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.832911 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.833056 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.833191 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.833351 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.833436 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.833673 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.833762 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.833975 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.834074 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.834277 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.834362 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.834578 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.834663 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.834879 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.834973 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.835180 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.835272 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.835481 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.835566 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.835783 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.835877 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.836084 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.836170 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.836388 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.836472 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.836699 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.836791 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.836998 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.837092 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.837298 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.837385 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.837618 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.837706 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.837923 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.838025 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.838226 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.838319 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.838526 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.838620 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.838825 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.838912 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.839126 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.839212 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.839434 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.839519 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.839736 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.839874 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.840041 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.840135 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.840341 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.840427 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.840643 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.840736 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.840945 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.841032 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.841240 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.841337 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.841540 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.841674 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.841867 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.841969 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.842166 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.842252 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.842468 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.842554 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.842767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.842968 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.843056 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.843135 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.843353 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.843442 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.843652 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.843747 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.843949 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.844043 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.844246 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.844332 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.844539 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.844634 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.844837 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.844922 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.845142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.845227 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.845442 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.845536 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.845769 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.845856 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.846072 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.846157 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.846377 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.846464 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.846700 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:37:38.846797 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.847025 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.847112 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.847353 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.847439 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.847661 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.847790 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.848576 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.848684 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.848875 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.848966 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.849197 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.849283 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.849507 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.849630 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.849842 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.849937 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.850153 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.850239 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.850459 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.850553 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.850768 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.850855 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.851076 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.851162 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.851385 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.851481 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.851697 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.851783 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.852015 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.852109 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.852326 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.852420 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.852905 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.853043 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.853219 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.853351 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.853525 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.853677 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.853860 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.853954 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.854180 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.854277 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.854494 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.854608 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.854801 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.854898 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.855112 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.855199 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.855456 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.855551 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.855765 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.855851 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.856087 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.856173 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.856403 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.856491 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.856710 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.856797 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.857018 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.857112 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.857323 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.857422 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.857653 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.857741 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.857978 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.858062 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.858285 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.858381 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.858597 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.858684 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.858902 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.859002 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.859210 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.859304 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.859515 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.859600 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.859821 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.859919 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.860127 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.860220 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.860434 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.860519 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.860753 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.860846 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.861063 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.861149 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.861370 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.861463 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.861704 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.861806 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.862011 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.862100 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.862317 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.862414 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.862622 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.862717 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.862923 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.863010 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.863222 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.863319 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.863541 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.863630 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.863885 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.863968 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.864143 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.864230 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.864449 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.864543 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.864768 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.864867 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.865071 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.865168 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.865387 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.865480 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.865707 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.865794 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.866015 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.866092 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.866320 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.866406 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.866625 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.866708 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.866924 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.867008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.867226 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.867310 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.867529 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.867603 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.867827 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.867912 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.868126 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.868201 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.868438 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.868511 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.868739 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.868823 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.869040 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.869115 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.869347 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.869427 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.869667 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.869774 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870027 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870126 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870284 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870368 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870596 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870733 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870882 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.870968 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.871188 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.871265 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.871507 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.871596 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.871812 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.871906 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.872117 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.872215 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.872424 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.872510 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.872757 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.872844 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.873055 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.873141 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.873374 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.873460 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.873719 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.873810 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.874029 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.874128 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.874327 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.874413 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.874630 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.874770 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.874928 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.875027 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.875226 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.875313 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.875524 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.875609 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.875823 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.875921 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.876119 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.876205 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.876416 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.876501 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.876712 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.876805 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.877010 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.877097 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.877307 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.877392 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.877630 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.877720 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.877938 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.878023 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.878237 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.878392 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.878534 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.878623 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.878833 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.878928 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.879664 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.879812 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.879995 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.880146 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.880296 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.880437 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.880624 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.880713 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.880941 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.881028 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.881257 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.881342 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.881578 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.881687 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.881897 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.881985 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.882204 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.882297 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.882511 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.882610 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.882816 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.882907 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.883122 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.883208 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.883428 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.883521 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.883733 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.883818 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.884045 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.884129 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.884351 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.884445 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.884657 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.884742 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.884960 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.885053 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.885273 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.885360 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.885579 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.885666 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.885906 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.885992 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.886218 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.886305 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.886555 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.886640 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.886866 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.886951 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.887182 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.887270 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.887487 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.887582 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.887794 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.887886 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.888097 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.888190 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.888401 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.888488 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.888705 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.888790 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.889008 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.889099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.889314 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.889406 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.889637 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.889739 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.889951 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.890048 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.890252 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.890336 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.890560 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.890654 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.890860 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.890945 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.891170 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.891257 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.891469 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.891564 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.891768 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.891853 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.892077 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.892162 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.892400 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.892493 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.892706 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.892794 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.893011 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.893099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.893317 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.893403 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.893641 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.893741 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.893948 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.894035 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.894255 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.894343 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.894556 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.894643 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.895402 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.895571 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.895792 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.895881 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.895996 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.896083 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.896298 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.896382 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.896605 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.896693 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.896905 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.896992 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.897204 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.897297 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.897505 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.897653 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.897829 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.897925 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.898126 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.898220 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.898427 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.898556 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.898734 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.898822 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.899039 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.899139 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.899345 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.899433 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.899657 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.899769 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.899956 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.900053 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.900253 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.900340 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.900550 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.900634 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.900865 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.900961 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.901173 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.901259 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.901474 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.901649 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.901803 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.901892 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.902107 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.902203 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.902447 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.902541 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.902752 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.902838 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.903050 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.903135 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.903366 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.903454 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.903668 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.903754 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.903976 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.904062 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.904280 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.904367 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.904582 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.904677 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.904885 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.904969 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.905189 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.905284 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.905492 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.905604 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.905820 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.905906 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.906120 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.906218 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.906422 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.906509 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.906724 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.906810 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.907027 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.907126 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.907330 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.907415 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.907633 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.907719 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.907936 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.908033 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.908232 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.908318 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.908528 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.908609 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.908835 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.908922 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.909149 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.909412 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.909745 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.909836 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.910071 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.910157 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.910424 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.910538 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.910740 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.910826 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.911055 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.911205 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.911371 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.911457 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.911695 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.911789 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.912020 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.912113 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.912320 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.912415 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.912629 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.912725 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.912932 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.913019 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.913232 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.913321 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.913533 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.913635 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.913858 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.913945 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.914161 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.914256 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.914460 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.914547 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.914761 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.914854 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.915057 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.915143 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.915354 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.915441 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.915650 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.915746 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.915948 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.916033 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.916249 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.916347 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.916544 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.916643 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.916849 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.916937 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.917146 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.917232 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.917444 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.917541 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.917774 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.917860 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.918074 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.918171 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.918372 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.918468 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.918668 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.918802 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.918967 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.919063 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.919296 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.919385 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.919598 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.919683 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.919931 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.920026 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.920258 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.920346 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.920558 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.920643 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.920859 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.920945 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.921177 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.921264 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.921476 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.921583 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.921798 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.921900 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.922096 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.922184 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.922392 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.922477 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.922695 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.922793 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.922992 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.923089 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.923291 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.923378 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.923592 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.923687 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.923894 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.923981 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.924196 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.924284 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.924494 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.924589 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.924792 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.924877 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.925087 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.925174 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.925386 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.925472 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.925712 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.925814 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.926095 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.926192 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.926396 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.926493 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.926701 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.926788 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927003 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927093 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927299 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927396 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927597 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927683 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927890 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.927976 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.928191 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.928285 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.928486 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.928571 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.928782 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.928926 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.929079 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.929166 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.929380 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.929475 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.929703 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.929804 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930002 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930089 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930298 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930383 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930607 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930701 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930903 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.930991 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.931198 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.931333 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.931498 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.931594 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.931813 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.931917 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.932087 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.932175 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.932389 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.932486 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.932704 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.932791 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.933013 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.933101 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.933311 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.933400 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.933643 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.933732 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.933942 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.934029 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.934240 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.934337 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.934537 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.934625 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.934836 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.934921 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.935129 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.935216 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.935426 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.935512 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.935722 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.935815 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.936018 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.936105 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.936316 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.936403 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.936617 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.936711 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.936921 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.937006 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.937217 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.937303 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.937515 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.937660 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.937836 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.937922 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.938134 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.938232 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.938464 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.938559 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.938764 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.938850 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.939110 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.939195 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.939409 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.939496 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.939722 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.939808 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.940028 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.940113 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.940335 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.940422 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.940642 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.940726 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.940941 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.941035 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.941241 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.941327 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.941544 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.942227 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.942375 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.942518 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.942663 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.942801 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.942962 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.943051 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.943267 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.943362 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.943574 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.943661 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.943880 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.943976 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.944187 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.944283 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.944503 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.944589 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.944820 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.944907 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.945118 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.945214 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.945422 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.945509 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.945750 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.945839 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.946053 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.946155 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.946355 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.946442 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.946658 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.946753 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.946962 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.947058 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.947267 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.947355 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.947572 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.947659 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.947876 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.947966 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.948180 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.948275 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.948479 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.948573 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.948780 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.948867 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.949086 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.949180 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.949384 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.949471 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.949708 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.949796 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.950021 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.950106 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.950321 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.950408 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.950622 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.950717 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.950919 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.951004 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.951219 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.951313 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.951514 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.951600 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.951815 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.952019 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.952244 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.952340 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.952554 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.952641 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.952863 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.952950 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.953168 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.953263 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.953479 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.953583 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.953813 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.953900 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.954127 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.954225 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.954425 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.954510 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.954729 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.954821 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.955127 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.955214 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.955433 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.955521 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.955737 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.955832 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.956038 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.956126 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.956336 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.956433 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.956637 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.956723 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.956952 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.957040 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.957304 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.957397 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.958126 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.958436 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.958536 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.958740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.958828 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.959062 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.959367 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.959469 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.959673 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.959767 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.959994 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.960084 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.960385 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.960483 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.960690 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.960778 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.961002 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.961088 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.961401 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.961500 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.961735 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.961823 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.962040 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.962138 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.962361 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.962462 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.962677 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.962765 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.962981 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.963066 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.963284 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.963381 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.963589 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.963685 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.963892 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.963980 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.964211 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.964298 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.964518 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.964605 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.964825 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.964911 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.965133 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.965240 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.965425 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.965523 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.966638 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.966725 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.966794 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967282 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967380 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967451 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967517 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967583 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967656 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967724 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967818 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.967931 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.968016 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.968261 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.968337 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.968592 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.968680 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.968900 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.968994 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.969210 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.969347 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.969516 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.969634 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.969850 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.969983 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.970157 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.970243 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.970477 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.970565 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.970780 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.970869 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.971088 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.971175 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.971397 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.971486 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.971704 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.971792 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.972004 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.972102 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.972304 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.972392 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.972622 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.972718 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.972948 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.973049 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.973268 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.973346 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.973593 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.973673 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.973916 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.974020 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.974235 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.974322 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.974536 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.974661 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.974856 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.975015 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.975161 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.975249 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.975461 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.975549 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.975760 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.975849 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.976060 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.976147 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.976398 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.976483 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.976697 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.976793 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.977012 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.977099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.977335 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.977422 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.977948 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.978045 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.978259 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.978352 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.978588 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.978675 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.978908 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.978997 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.979224 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.979347 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.979534 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.979632 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.979854 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.979941 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.980157 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.980242 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.980455 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.980549 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.980758 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.980845 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.981058 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.981144 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.981356 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.981456 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.981677 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.981770 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.981980 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.982067 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.982277 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.982376 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.982574 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.982660 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.982873 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.982959 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.983188 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.983274 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.983486 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.983572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.983802 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.983889 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.984105 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.984191 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.984404 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.984502 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.984703 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.984796 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.985001 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.985095 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.985336 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.985422 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.985658 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.985758 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.985981 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.986070 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.986287 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.986373 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.986604 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.986702 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.986914 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.987003 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.987225 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.987311 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.987533 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.987628 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.987841 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.987937 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.988150 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.988239 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.988482 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.988654 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.988794 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.988887 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.989097 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.989183 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.989405 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.989547 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.989739 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.989834 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.990052 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.990138 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.990574 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.990668 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.990896 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.990983 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.991206 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.991300 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.991513 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.991600 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.991821 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.991908 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.992127 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.992212 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.992433 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.992520 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.992736 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.992822 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.993040 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.993136 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.993346 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.993432 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.993672 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.993762 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.993994 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.994094 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.994310 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.994399 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.994630 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.994719 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.994959 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.995054 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.995271 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.995358 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.995581 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.995677 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.995889 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.995976 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.996194 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.996280 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.996542 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.996632 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.996850 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.996937 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.997147 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.997233 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.997454 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.997550 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.997788 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.997886 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.998096 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.998181 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.998401 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.998495 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.998702 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.998788 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.999007 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.999094 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.999312 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.999406 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.999616 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.999703 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:38.999920 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.000005 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.000228 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.000362 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.000532 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.000617 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.000848 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.000936 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.001175 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.001262 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.001486 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.001665 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.001820 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.001907 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.002130 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.002226 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.002443 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.002530 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.002957 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.003053 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.003271 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.003366 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.003594 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.003718 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.003913 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.004009 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.005790 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006233 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006233 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006388 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006388 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006548 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006632 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006710 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006789 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006875 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.006956 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007045 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007133 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007214 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007293 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007375 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007463 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007544 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007701 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007823 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.007920 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.008012 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.008093 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.008313 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.008401 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.008620 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.008715 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.009147 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.009236 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.009490 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.009595 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.009824 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.009910 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.010143 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.010231 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.010459 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.010545 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.010770 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.010864 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.011067 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.011154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.011383 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.011478 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.011682 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.011776 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.011980 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.012066 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.012288 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.012373 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.012591 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.012685 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.012889 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.012975 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.013186 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.013279 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.013491 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.013633 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.013821 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.013916 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.014119 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.014206 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.014421 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.014508 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.014718 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.014803 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.015036 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.015121 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.015336 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.015424 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.015633 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.015718 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.015928 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.016013 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.016232 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.016320 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.016530 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.016623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.016825 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.016917 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.017122 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.017210 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.017418 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.017505 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.017747 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.017910 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.018044 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.018131 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.018345 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.018431 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.018642 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.018736 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.018944 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.019043 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.019239 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.019326 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.019542 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.019638 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.020384 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.020593 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.020750 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.020901 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.020993 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.021087 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.021316 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.021404 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.021650 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.021742 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.021957 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.022055 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.022273 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.022360 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.022580 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.022665 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.022884 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.022972 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.023223 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.023311 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.023535 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.023633 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.024065 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.024152 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.024398 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.024485 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.024719 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.024814 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.025052 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.025138 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.025380 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.025466 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.025709 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.025811 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.026014 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.026101 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.026313 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.026398 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.026634 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.026728 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.026941 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.027027 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.027247 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.027333 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.027551 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.027645 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.027857 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.027952 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.028162 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.028249 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.028468 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.028557 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.028775 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.028871 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.029082 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.029169 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.029386 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.029473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.029775 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.029877 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.030083 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.030174 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.030391 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.030529 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.030703 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.030802 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.031008 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.031105 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.031317 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.031411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.031652 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.031746 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.031966 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.032062 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.032278 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.032364 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.032586 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.032679 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.032896 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.032993 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.033202 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.033289 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.033503 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.033666 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.033831 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.033929 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.034135 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.034232 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.034443 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.034529 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.034765 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.034855 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.035073 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.035169 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.035398 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.035517 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.035812 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.035947 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.036120 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.036210 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.036433 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.036520 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.036748 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.036845 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.037054 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.037142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.037372 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.037473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.037712 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.037804 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.038021 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.038110 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.038335 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.038432 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.038641 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.038729 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.038966 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.039052 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.039299 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.039399 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.039622 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.039710 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.039943 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.040032 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.040245 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.040333 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.040548 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.040674 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.040845 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.040934 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.041150 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.041238 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.041462 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.041556 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.041792 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.041879 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.042093 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.042181 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.042389 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.042475 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.042693 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.042789 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.042991 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.043078 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.043290 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.043385 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.043587 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.043683 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.043886 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.043979 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.044187 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.044273 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.044482 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.044581 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.044779 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.044866 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.045074 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.045168 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.045372 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.045468 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.045693 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.045783 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.045992 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.046079 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.046295 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.046384 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.046594 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.046680 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.046891 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.046977 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.047189 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.047278 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.047487 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.047575 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.047784 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.047872 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.048108 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.048195 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.048433 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.048529 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.048742 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.048830 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.049057 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.049146 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.049361 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.049456 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.049699 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.049802 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.050007 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.050093 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.050321 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.050418 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.050637 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.050779 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.050967 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.051060 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.051275 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.051362 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.051600 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.051696 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.051905 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.051991 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.052254 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.052347 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.052510 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.052608 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.052815 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.052902 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.053120 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.053214 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.053423 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.053509 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.053766 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.053865 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.054087 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.054182 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.054388 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.054483 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.054705 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.054798 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.055016 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.055103 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.055330 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.055417 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.055640 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.055733 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.055942 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.056038 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.056263 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.056350 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.056567 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.056652 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.056871 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.056967 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.057174 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.057262 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.057479 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.057621 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.057807 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.057904 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.058114 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.058201 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.058418 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.058505 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.058722 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.058809 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.059031 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.059118 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.059342 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.059429 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.059659 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.059745 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.059978 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.060063 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.060279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.060366 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.060597 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.060684 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.060916 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.061013 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.061254 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.061351 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.061577 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.061721 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.061918 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.062054 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.062237 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.062380 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.062546 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.062642 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.062851 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.062939 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.063153 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.063252 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:37:39.063391 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:37:39.063485 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:37:39.217259 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Registered counter for database nova_api Aug 24 05:37:39.217550 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Registered counter for database nova_api Aug 24 05:37:39.240100 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.241754 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.246982 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.248203 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.304481 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.context [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96507276-ed40-4723-bde2-cb864799ff28(cell1) {{(pid=112171) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:37:39.304912 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.context [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96507276-ed40-4723-bde2-cb864799ff28(cell1) {{(pid=112170) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:37:39.308320 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:39.308777 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:39.308887 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:39.309245 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:39.310386 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:39.310852 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:39.311133 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:39.311583 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:39.311686 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:39.312026 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:39.313591 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:39.314029 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_concurrency.lockutils [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:39.315544 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Registered counter for database nova_cell0 Aug 24 05:37:39.315974 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Registered counter for database nova_cell0 Aug 24 05:37:39.321825 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Registered counter for database nova_cell1 Aug 24 05:37:39.321976 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Registered counter for database nova_cell1 Aug 24 05:37:39.328818 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.330573 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.333449 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.334175 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.335611 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.339690 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.341165 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.475612 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.484431 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO dbcounter [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Registered counter for database nova_cell0 Aug 24 05:37:39.487875 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO dbcounter [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Registered counter for database nova_cell0 Aug 24 05:37:39.494481 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_db.sqlalchemy.engines [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.497971 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG oslo_db.sqlalchemy.engines [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:37:39.498904 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writer thread running {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.502371 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writer thread running {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:37:39.833156 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:37:39.839255 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:37:39.840340 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:37:39.846483 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:37:40.180857 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:37:40.186841 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: WARNING keystonemiddleware.auth_token [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:37:40.192781 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cf768e9c0 pid: 112171 (default app) Aug 24 05:37:40.192963 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:37:40.194949 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:40.196122 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001780 Aug 24 05:37:40.196514 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 788 bytes} [Wed Aug 24 05:37:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:40.199011 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: WARNING keystonemiddleware.auth_token [None req-258d776e-8092-4f3e-a1be-872018ba2044 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:37:40.204343 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558cf768e9c0 pid: 112170 (default app) Aug 24 05:38:58.238247 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:58.239184 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 24 05:38:58.239585 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:38:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:38:58.251612 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:SELECT=3 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.254191 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell0:SELECT=3 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.255109 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell1:SELECT=3 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:58.255590 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:59.135098 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-5690850b-6df6-4744-b28e-d743342dc3f1 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:59.167088 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-5690850b-6df6-4744-b28e-d743342dc3f1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920628 Aug 24 05:38:59.167830 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 05:38:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:01.562015 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:01.563257 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-07c67d12-388b-4912-9590-33e369d7a230 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 05:39:01.572350 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 3/4] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:39:02.005463 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-322ae90f-8c01-4583-b58d-eb973c26e9b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:02.026830 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:02.026830 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: warnings.warn(msg) Aug 24 05:39:02.057873 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-322ae90f-8c01-4583-b58d-eb973c26e9b8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487281 Aug 24 05:39:02.058756 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 2/5] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:02.282661 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-4701bc3c-27a6-4f34-bcdb-29f1597491e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:02.282661 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:02.282661 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: warnings.warn(msg) Aug 24 05:39:02.286151 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=3 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:02.288187 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell1:SELECT=3 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:02.288187 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell0:SELECT=3 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:02.290132 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:02.350025 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-4701bc3c-27a6-4f34-bcdb-29f1597491e1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282962 Aug 24 05:39:02.350792 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 4/6] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 05:39:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:04.722190 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-322ae90f-8c01-4583-b58d-eb973c26e9b8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:04.723195 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-322ae90f-8c01-4583-b58d-eb973c26e9b8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 24 05:39:04.723770 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 3/7] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:05.412037 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-99587146-d951-4de7-9c36-8555d239221f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "name": "ds512M", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:05.432215 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:05.432215 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: warnings.warn(msg) Aug 24 05:39:05.453895 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-99587146-d951-4de7-9c36-8555d239221f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.723449 Aug 24 05:39:05.455035 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 5/8] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:05.466850 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-11ccbe3f-73cd-4494-ac9e-0e43e4d7e85d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:05.469934 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:39:05.469934 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: warnings.warn(msg) Aug 24 05:39:05.505550 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-11ccbe3f-73cd-4494-ac9e-0e43e4d7e85d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042405 Aug 24 05:39:05.514248 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 4/9] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 05:39:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:07.996451 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-99587146-d951-4de7-9c36-8555d239221f admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:07.997489 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-99587146-d951-4de7-9c36-8555d239221f admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Aug 24 05:39:07.997917 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:08.400821 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-8e3c6bfd-0752-42c0-96f4-e680aaeb6534 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "disk": 10, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:08.419568 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-8e3c6bfd-0752-42c0-96f4-e680aaeb6534 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.414928 Aug 24 05:39:08.420127 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 5/11] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:08.432745 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-d2af7104-ac09-4b65-a7e7-08945cb4027d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:08.456092 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-d2af7104-ac09-4b65-a7e7-08945cb4027d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027003 Aug 24 05:39:08.456672 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 7/12] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 05:39:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:10.825665 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-8e3c6bfd-0752-42c0-96f4-e680aaeb6534 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:10.826700 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-8e3c6bfd-0752-42c0-96f4-e680aaeb6534 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 24 05:39:10.827387 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 6/13] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:11.324333 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-6a04f279-c20f-4183-b82b-2c04153b6458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "name": "ds2G"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:11.346671 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-6a04f279-c20f-4183-b82b-2c04153b6458 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512448 Aug 24 05:39:11.347369 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 8/14] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:11.359687 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-2a615160-2eba-471a-b653-b1102d9a22f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:11.384248 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-2a615160-2eba-471a-b653-b1102d9a22f1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028208 Aug 24 05:39:11.385717 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 7/15] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 05:39:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:13.777919 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-6a04f279-c20f-4183-b82b-2c04153b6458 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:13.778985 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-6a04f279-c20f-4183-b82b-2c04153b6458 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Aug 24 05:39:13.779420 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 9/16] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:14.221710 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-23fd60d6-2dac-4ff6-833a-7009cef9e262 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096, "disk": 20}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:14.243411 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-23fd60d6-2dac-4ff6-833a-7009cef9e262 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455835 Aug 24 05:39:14.243971 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 8/17] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:14.256273 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-f0f0f053-2194-4392-bab0-3631b197204c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:14.281824 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-f0f0f053-2194-4392-bab0-3631b197204c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029026 Aug 24 05:39:14.283454 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 10/18] 10.222.0.73 () {64 vars in 1336 bytes} [Wed Aug 24 05:39:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:16.672734 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-23fd60d6-2dac-4ff6-833a-7009cef9e262 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:16.673807 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-23fd60d6-2dac-4ff6-833a-7009cef9e262 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 24 05:39:16.674255 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 9/19] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:17.104630 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-1afcf8ab-e625-45da-b858-f9979a02e792 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:17.136822 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-1afcf8ab-e625-45da-b858-f9979a02e792 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456235 Aug 24 05:39:17.137514 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 11/20] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 05:39:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:19.492314 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-23fd60d6-2dac-4ff6-833a-7009cef9e262 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:19.493709 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-23fd60d6-2dac-4ff6-833a-7009cef9e262 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Aug 24 05:39:19.494252 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 10/21] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:19.930197 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-ce91c84d-00d7-4384-990c-7d8866f4f49e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "1"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:19.950378 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-ce91c84d-00d7-4384-990c-7d8866f4f49e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.450076 Aug 24 05:39:19.950954 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 12/22] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:19.965351 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-f8e84be1-94ca-46b3-b50b-cab32fef8e98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:19.996729 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-f8e84be1-94ca-46b3-b50b-cab32fef8e98 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036600 Aug 24 05:39:19.997328 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 11/23] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 05:39:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:22.441689 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-ce91c84d-00d7-4384-990c-7d8866f4f49e admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:22.442710 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-ce91c84d-00d7-4384-990c-7d8866f4f49e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 24 05:39:22.443124 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 13/24] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:22.851281 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-cfecde0e-21f7-447e-b15f-b48609815eac admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "id": "2", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:22.869863 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-cfecde0e-21f7-447e-b15f-b48609815eac admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420557 Aug 24 05:39:22.870417 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 12/25] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:39:22.882350 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-4eaed11c-b3da-410f-9956-0073c68cb157 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:22.906450 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-4eaed11c-b3da-410f-9956-0073c68cb157 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027709 Aug 24 05:39:22.907887 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 14/26] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 05:39:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:39:25.288884 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-cfecde0e-21f7-447e-b15f-b48609815eac admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:25.288884 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-cfecde0e-21f7-447e-b15f-b48609815eac admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 05:39:25.288884 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:25.663957 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-2c395598-b7bf-44c5-865b-f64d5a7c1485 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:25.684063 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-2c395598-b7bf-44c5-865b-f64d5a7c1485 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.383017 Aug 24 05:39:25.689603 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 15/28] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:39:25.697207 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-ecc4d33e-1a3a-4e55-b145-d141ade9aee8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:25.724608 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-ecc4d33e-1a3a-4e55-b145-d141ade9aee8 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031280 Aug 24 05:39:25.725508 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 14/29] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 05:39:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:28.068786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-2c395598-b7bf-44c5-865b-f64d5a7c1485 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:28.069999 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-2c395598-b7bf-44c5-865b-f64d5a7c1485 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 24 05:39:28.070488 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:28.528081 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-b927e0c8-52e4-4428-ad6e-ca276bc558ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "ram": 8192, "id": "4", "name": "m1.large", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:28.537787 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:28.603493 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-b927e0c8-52e4-4428-ad6e-ca276bc558ad admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.526546 Aug 24 05:39:28.605244 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 15/31] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:28.618600 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-19673430-1abc-47dc-9725-9be09b728a3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:28.668338 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-19673430-1abc-47dc-9725-9be09b728a3f admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053753 Aug 24 05:39:28.674388 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 17/32] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 05:39:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:31.072954 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-b927e0c8-52e4-4428-ad6e-ca276bc558ad admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:31.073997 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-b927e0c8-52e4-4428-ad6e-ca276bc558ad admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 24 05:39:31.074399 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 16/33] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:31.537932 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-92ec6a17-f5a7-4d21-b1d3-9d041026e7c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "id": "5", "swap": 0, "vcpus": 8, "ram": 16384}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:31.559992 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-92ec6a17-f5a7-4d21-b1d3-9d041026e7c1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.478420 Aug 24 05:39:31.560857 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 18/34] 10.222.0.73 () {64 vars in 1283 bytes} [Wed Aug 24 05:39:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:31.573540 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-f2708fee-c8fb-4c64-8fed-7c6399283f00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:31.607468 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-f2708fee-c8fb-4c64-8fed-7c6399283f00 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037290 Aug 24 05:39:31.609697 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 17/35] 10.222.0.73 () {64 vars in 1333 bytes} [Wed Aug 24 05:39:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:50.152199 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-92ec6a17-f5a7-4d21-b1d3-9d041026e7c1 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:50.153127 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-92ec6a17-f5a7-4d21-b1d3-9d041026e7c1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 05:39:50.153529 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 19/36] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:50.164291 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:50.543849 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-55d7aab3-cf34-4a2a-bf26-a34c3f9865ea admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:50.562121 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-55d7aab3-cf34-4a2a-bf26-a34c3f9865ea admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402219 Aug 24 05:39:50.562668 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 05:39:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:39:51.623469 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-92ec6a17-f5a7-4d21-b1d3-9d041026e7c1 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:51.624515 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-92ec6a17-f5a7-4d21-b1d3-9d041026e7c1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 05:39:51.624947 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 20/38] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:52.144290 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-2d2e99e1-160d-4db2-a23d-60da0f6bb217 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:52.149935 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.wsgi [None req-2d2e99e1-160d-4db2-a23d-60da0f6bb217 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-2d2e99e1-160d-4db2-a23d-60da0f6bb217 admin admin] Request method failure captured: Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Accept: application/json Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Accept-Encoding: gzip, deflate Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Connection: keep-alive Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Content-Length: 0 Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Host: 10.222.0.73 Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Openstack-Api-Version: compute 2.90 Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Openstack-System-Scope: None Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: User-Agent: python-novaclient Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Auth-Token: gAAAAABjBbmn0-HJvaRGQkW0xjShwBo_GwYeAoFH28sAS-lqWnu2pAtrJO1VOPPKQVHDzFYyG2TPhhGkv-Ns5FXNpDZszzRvH3UfpYug3K3bkJFi0EVDxftSRqbY9ghzgHA5Q1RLukcgqWiig32DuPAz6SnhKorjsnkPKdC7YPivqRiLekJzfAs Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Domain-Id: None Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Domain-Name: None Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Identity-Status: Confirmed Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Is-Admin-Project: True Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Domain-Id: default Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Domain-Name: Default Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Name: admin Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Role: member,reader,admin Aug 24 05:39:52.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Roles: member,reader,admin Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant: admin Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant-Name: admin Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User: admin Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Domain-Id: default Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Domain-Name: Default Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Id: a3d3f4f0c68b4b679ab49519fa363f6e Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Name: admin Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: method: > Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: exception: Flavor 42 could not be found. Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: action_args: {'id': '42'} Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:52.154748 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:52.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.156740 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-2d2e99e1-160d-4db2-a23d-60da0f6bb217 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:52.158847 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-2d2e99e1-160d-4db2-a23d-60da0f6bb217 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392262 Aug 24 05:39:52.158847 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 05:39:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:52.167224 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-1473f190-5318-42ce-b8a0-b9d96fcffc0c admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:52.171473 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:52.196752 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-1473f190-5318-42ce-b8a0-b9d96fcffc0c admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034889 Aug 24 05:39:52.197620 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 21/40] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 05:39:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:52.212460 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-1be1b30d-abd1-4206-97be-b8adcd33ba58 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:52.244089 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-1be1b30d-abd1-4206-97be-b8adcd33ba58 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037278 Aug 24 05:39:52.244638 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 05:39:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:52.256968 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-f0476d0f-6926-4689-8188-73bf89a68172 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:52.263615 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.wsgi [None req-f0476d0f-6926-4689-8188-73bf89a68172 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-f0476d0f-6926-4689-8188-73bf89a68172 admin admin] Request method failure captured: Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Accept: application/json Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Accept-Encoding: gzip, deflate Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Connection: keep-alive Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Content-Length: 0 Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Host: 10.222.0.73 Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Openstack-Api-Version: compute 2.90 Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Openstack-System-Scope: None Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: User-Agent: python-novaclient Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Auth-Token: gAAAAABjBbmn0-HJvaRGQkW0xjShwBo_GwYeAoFH28sAS-lqWnu2pAtrJO1VOPPKQVHDzFYyG2TPhhGkv-Ns5FXNpDZszzRvH3UfpYug3K3bkJFi0EVDxftSRqbY9ghzgHA5Q1RLukcgqWiig32DuPAz6SnhKorjsnkPKdC7YPivqRiLekJzfAs Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Domain-Id: None Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Domain-Name: None Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Identity-Status: Confirmed Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Is-Admin-Project: True Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Domain-Id: default Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Domain-Name: Default Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Name: admin Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Role: member,reader,admin Aug 24 05:39:52.267522 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Roles: member,reader,admin Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant: admin Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant-Name: admin Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User: admin Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Domain-Id: default Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Domain-Name: Default Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Id: a3d3f4f0c68b4b679ab49519fa363f6e Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Name: admin Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: method: > Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: exception: Flavor 42 could not be found. Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: action_args: {'id': '42'} Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:52.268970 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:52.269786 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:52.270840 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-f0476d0f-6926-4689-8188-73bf89a68172 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:52.271791 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-f0476d0f-6926-4689-8188-73bf89a68172 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016532 Aug 24 05:39:52.271791 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 05:39:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:53.250177 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-1be1b30d-abd1-4206-97be-b8adcd33ba58 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:53.251225 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-1be1b30d-abd1-4206-97be-b8adcd33ba58 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 24 05:39:53.251613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 21/43] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:53.772888 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-b8f6f5f1-35a0-43f0-b0ce-1d9c42da936a admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:53.778208 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.wsgi [None req-b8f6f5f1-35a0-43f0-b0ce-1d9c42da936a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-b8f6f5f1-35a0-43f0-b0ce-1d9c42da936a admin admin] Request method failure captured: Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Accept: application/json Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Accept-Encoding: gzip, deflate Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Connection: keep-alive Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Content-Length: 0 Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Host: 10.222.0.73 Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Openstack-Api-Version: compute 2.90 Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Openstack-System-Scope: None Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: User-Agent: python-novaclient Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Auth-Token: gAAAAABjBbmpF4r3zgf7x68HTIjG4PkHebHdPLGpnWGgmEFmAoPmnoEgbyRoysZKJGtCewOTnaECxzG65AIMusEq2TYS44VS4_Q5nF06fNoe2B3PIJKo9rTpEUBFF5YGf6Sh3yaexG4_5WrUWgfbxPafgjlwgl4pU3hsCRFxtEbszs2DS9wgJ0Y Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Domain-Id: None Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Domain-Name: None Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Identity-Status: Confirmed Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Is-Admin-Project: True Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Domain-Id: default Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Domain-Name: Default Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Name: admin Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Role: member,reader,admin Aug 24 05:39:53.779800 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Roles: member,reader,admin Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant: admin Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant-Name: admin Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User: admin Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Domain-Id: default Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Domain-Name: Default Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Id: a3d3f4f0c68b4b679ab49519fa363f6e Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Name: admin Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: method: > Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: exception: Flavor 84 could not be found. Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: action_args: {'id': '84'} Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:53.781279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:53.782424 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.783767 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-b8f6f5f1-35a0-43f0-b0ce-1d9c42da936a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:53.785024 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-b8f6f5f1-35a0-43f0-b0ce-1d9c42da936a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393046 Aug 24 05:39:53.785024 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 05:39:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:53.793259 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-4261e00c-e0f2-4928-9e3c-19e8c951d468 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:53.818014 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-4261e00c-e0f2-4928-9e3c-19e8c951d468 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030091 Aug 24 05:39:53.819000 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 05:39:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:53.829234 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-e0d31947-e738-43e0-ab7f-4d4c78ac42e3 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:53.845768 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-e0d31947-e738-43e0-ab7f-4d4c78ac42e3 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020472 Aug 24 05:39:53.846309 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 05:39:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:53.856124 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-163191e9-2f2b-4ac1-b3d3-eac47059f7e8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:53.862071 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.wsgi [None req-163191e9-2f2b-4ac1-b3d3-eac47059f7e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-163191e9-2f2b-4ac1-b3d3-eac47059f7e8 admin admin] Request method failure captured: Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Accept: application/json Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Accept-Encoding: gzip, deflate Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Connection: keep-alive Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Content-Length: 0 Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Host: 10.222.0.73 Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Openstack-Api-Version: compute 2.90 Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Openstack-System-Scope: None Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: User-Agent: python-novaclient Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Auth-Token: gAAAAABjBbmpF4r3zgf7x68HTIjG4PkHebHdPLGpnWGgmEFmAoPmnoEgbyRoysZKJGtCewOTnaECxzG65AIMusEq2TYS44VS4_Q5nF06fNoe2B3PIJKo9rTpEUBFF5YGf6Sh3yaexG4_5WrUWgfbxPafgjlwgl4pU3hsCRFxtEbszs2DS9wgJ0Y Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Domain-Id: None Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Domain-Name: None Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Identity-Status: Confirmed Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Is-Admin-Project: True Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Domain-Id: default Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Domain-Name: Default Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Name: admin Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Role: member,reader,admin Aug 24 05:39:53.863572 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Roles: member,reader,admin Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant: admin Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant-Name: admin Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User: admin Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Domain-Id: default Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Domain-Name: Default Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Id: a3d3f4f0c68b4b679ab49519fa363f6e Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Name: admin Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: method: > Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: exception: Flavor 84 could not be found. Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: action_args: {'id': '84'} Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:53.865099 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:53.866142 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:53.867712 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-163191e9-2f2b-4ac1-b3d3-eac47059f7e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:53.868927 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-163191e9-2f2b-4ac1-b3d3-eac47059f7e8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012675 Aug 24 05:39:53.868927 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1190 bytes} [Wed Aug 24 05:39:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 05:39:54.823078 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-e0d31947-e738-43e0-ab7f-4d4c78ac42e3 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:54.824088 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-e0d31947-e738-43e0-ab7f-4d4c78ac42e3 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 05:39:54.824483 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:39:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:55.348355 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-98715187-27f4-4c82-a99d-ad6f1db080b7 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:55.354481 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.wsgi [None req-98715187-27f4-4c82-a99d-ad6f1db080b7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-98715187-27f4-4c82-a99d-ad6f1db080b7 admin admin] Request method failure captured: Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Accept: application/json Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Accept-Encoding: gzip, deflate Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Connection: keep-alive Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Content-Length: 0 Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Host: 10.222.0.73 Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Openstack-Api-Version: compute 2.90 Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Openstack-System-Scope: None Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: User-Agent: python-novaclient Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Auth-Token: gAAAAABjBbmqHkyyQhpVQX8AWlCY_nggcuVqF0OrBJ4IwtmAfI33nup8bcXB-yV8QPUjdshSRMNOg8BqxiQg4H9EK6UB-0JW1EZaI3X4pkpGsIrGkfDPv77ra2BB3EVt8kHAJ7gSlQeFg_br8j-Z3TZBabL63fj2CJwP6g89yVEb8N5AuYWE2Qc Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Domain-Id: None Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Domain-Name: None Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Identity-Status: Confirmed Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Is-Admin-Project: True Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Domain-Id: default Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Domain-Name: Default Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Project-Name: admin Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Role: member,reader,admin Aug 24 05:39:55.356008 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Roles: member,reader,admin Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant: admin Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-Tenant-Name: admin Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User: admin Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Domain-Id: default Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Domain-Name: Default Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Id: a3d3f4f0c68b4b679ab49519fa363f6e Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: X-User-Name: admin Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: method: > Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: exception: Flavor 451 could not be found. Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: action_args: {'id': '451'} Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:55.357532 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:55.358473 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.359613 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-98715187-27f4-4c82-a99d-ad6f1db080b7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:55.361414 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-98715187-27f4-4c82-a99d-ad6f1db080b7 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394721 Aug 24 05:39:55.361414 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 05:39:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:55.367892 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-990f8b69-fad8-40de-95bf-2cd0c3fa33bf admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:55.383219 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-990f8b69-fad8-40de-95bf-2cd0c3fa33bf admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018977 Aug 24 05:39:55.383744 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 05:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:55.393019 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:55.408197 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018650 Aug 24 05:39:55.408724 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 25/51] 10.222.0.73 () {60 vars in 1210 bytes} [Wed Aug 24 05:39:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:39:55.417845 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-7d4d21d1-33de-4cce-9a7b-75811f1af950 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:55.423864 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.wsgi [None req-7d4d21d1-33de-4cce-9a7b-75811f1af950 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-7d4d21d1-33de-4cce-9a7b-75811f1af950 admin admin] Request method failure captured: Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Accept: application/json Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Accept-Encoding: gzip, deflate Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Connection: keep-alive Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Content-Length: 0 Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Host: 10.222.0.73 Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Openstack-Api-Version: compute 2.90 Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Openstack-System-Scope: None Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: User-Agent: python-novaclient Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Auth-Token: gAAAAABjBbmqHkyyQhpVQX8AWlCY_nggcuVqF0OrBJ4IwtmAfI33nup8bcXB-yV8QPUjdshSRMNOg8BqxiQg4H9EK6UB-0JW1EZaI3X4pkpGsIrGkfDPv77ra2BB3EVt8kHAJ7gSlQeFg_br8j-Z3TZBabL63fj2CJwP6g89yVEb8N5AuYWE2Qc Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Domain-Id: None Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Domain-Name: None Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Identity-Status: Confirmed Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Is-Admin-Project: True Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Domain-Id: default Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Domain-Name: Default Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Project-Name: admin Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Role: member,reader,admin Aug 24 05:39:55.425349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Roles: member,reader,admin Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/136c4807ccbf43c49f1d29adcff44403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant: admin Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant-Id: 136c4807ccbf43c49f1d29adcff44403 Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-Tenant-Name: admin Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User: admin Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Domain-Id: default Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Domain-Name: Default Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Id: a3d3f4f0c68b4b679ab49519fa363f6e Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: X-User-Name: admin Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: method: > Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: exception: Flavor 451 could not be found. Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: action_args: {'id': '451'} Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:55.426644 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:55.427411 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: ERROR nova.api.openstack.wsgi Aug 24 05:39:55.428623 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-7d4d21d1-33de-4cce-9a7b-75811f1af950 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:55.429854 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-7d4d21d1-33de-4cce-9a7b-75811f1af950 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012402 Aug 24 05:39:55.429854 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 27/52] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 05:39:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 05:39:56.394131 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:56.395237 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Aug 24 05:39:56.395635 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:56.918908 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-eb63a578-9ded-4389-9dca-570e0b3d64e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:56.939094 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-eb63a578-9ded-4389-9dca-570e0b3d64e9 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404850 Aug 24 05:39:56.939636 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 28/54] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 05:39:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:57.899073 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:57.900108 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 05:39:57.900509 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:58.423254 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-3b4eb89f-3fb6-43ff-a499-c01e9ab6cb6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:58.441534 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-3b4eb89f-3fb6-43ff-a499-c01e9ab6cb6c admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400764 Aug 24 05:39:58.442101 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 29/56] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 05:39:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:39:59.407513 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:59.408516 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Aug 24 05:39:59.408907 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:59.932366 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-caf5063a-a6d6-43dc-a8e1-7a8595aaf07a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:59.956498 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-caf5063a-a6d6-43dc-a8e1-7a8595aaf07a admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.409930 Aug 24 05:39:59.957297 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 30/58] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 05:39:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:40:00.925694 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:00.926706 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 24 05:40:00.927134 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:40:01.447873 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-fe1bba46-b68f-4889-bd0f-fda181d2cd00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:01.466404 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-fe1bba46-b68f-4889-bd0f-fda181d2cd00 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.399422 Aug 24 05:40:01.467142 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 31/60] 10.222.0.73 () {64 vars in 1235 bytes} [Wed Aug 24 05:40:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:40:02.448484 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:02.449493 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 05:40:02.449923 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 30/61] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:40:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:40:02.978757 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-4663342d-eb0a-425a-bcce-f8c7332d68c9 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:03.000039 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-4663342d-eb0a-425a-bcce-f8c7332d68c9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409711 Aug 24 05:40:03.000585 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 32/62] 10.222.0.73 () {60 vars in 1202 bytes} [Wed Aug 24 05:40:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:40:56.172699 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:56.173763 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-45d4f771-dd9c-44d4-8b49-ef7b7c84cfc8 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 24 05:40:56.174169 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 931 bytes} [Wed Aug 24 05:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:40:56.185349 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:56.570527 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-5f065f79-889b-4e18-b83a-017ec1e40151 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:56.591014 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-5f065f79-889b-4e18-b83a-017ec1e40151 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410167 Aug 24 05:40:56.591550 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1292 bytes} [Wed Aug 24 05:40:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:40:56.612632 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG dbcounter [-] [112170] Writing DB stats nova_api:SELECT=14 {{(pid=112170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:56.617015 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-3fa3146e-8f69-4299-af87-5ad316ec1522 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:56.624633 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-3fa3146e-8f69-4299-af87-5ad316ec1522 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013429 Aug 24 05:40:56.625157 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 32/65] 10.222.0.73 () {60 vars in 1283 bytes} [Wed Aug 24 05:40:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:56.637414 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-603f9388-c16c-4604-b414-a59c87c1b53f admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:56.645120 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-603f9388-c16c-4604-b414-a59c87c1b53f admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011322 Aug 24 05:40:56.645654 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1286 bytes} [Wed Aug 24 05:40:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:56.656901 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:56.664570 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011218 Aug 24 05:40:56.665092 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 33/67] 10.222.0.73 () {60 vars in 1286 bytes} [Wed Aug 24 05:40:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:56.676653 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-a7185e33-a629-490c-960c-06f31c910d91 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:56.684279 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-a7185e33-a629-490c-960c-06f31c910d91 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011619 Aug 24 05:40:56.684782 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1283 bytes} [Wed Aug 24 05:40:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:43:52.580843 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:43:52.581882 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 24 05:43:52.582281 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 34/69] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:43:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:43:52.721415 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=6 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:43:52.878137 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:43:52.880451 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:43:52.880451 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: warnings.warn(msg) Aug 24 05:43:52.881591 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:52.882072 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:52.882499 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:52.883214 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:52.883658 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:52.884073 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:52.917183 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-6ec1599e-2ed9-4356-a21a-f3ad5b173b66 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197228 Aug 24 05:43:52.917772 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 36/70] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 05:43:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:43:53.742717 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:43:53.743787 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 24 05:43:53.744184 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 35/71] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:43:53.960152 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:43:53.962536 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:43:53.962536 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: warnings.warn(msg) Aug 24 05:43:53.963633 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:53.964106 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:53.964528 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:53.965239 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:43:53.965708 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:43:53.966118 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:43:53.985994 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-c5cf39af-d650-4021-ab30-a7eb400e23e4 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079111 Aug 24 05:43:53.986573 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 37/72] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 05:43:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:44:05.208700 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:05.209773 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 24 05:44:05.210202 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 36/73] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:44:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:05.351823 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell0:SELECT=4 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:05.352530 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_cell1:SELECT=4 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:05.353129 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG dbcounter [-] [112171] Writing DB stats nova_api:SELECT=8 {{(pid=112171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:05.401455 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:05.403892 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:44:05.403892 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: warnings.warn(msg) Aug 24 05:44:05.404988 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:05.405463 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:05.405925 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:05.406638 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:05.407087 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:05.407503 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:05.432358 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-d17adb93-ba87-408e-9ea9-d837ed982fe0 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084887 Aug 24 05:44:05.432922 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 38/74] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 05:44:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:44:06.246488 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: DEBUG nova.api.openstack.wsgi [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] Calling method '>' {{(pid=112170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:06.247498 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: INFO nova.api.openstack.requestlog [None req-267a6b02-e28e-450c-a995-8c732e05a2a9 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 24 05:44:06.247901 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: [pid: 112170|app: 0|req: 37/75] 10.222.0.73 () {56 vars in 1074 bytes} [Wed Aug 24 05:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:06.438572 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG nova.api.openstack.wsgi [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] Calling method '>' {{(pid=112171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:06.441008 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 05:44:06.441008 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: warnings.warn(msg) Aug 24 05:44:06.442155 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:06.442625 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:06.443048 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:06.443788 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:06.444237 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:06.444651 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: DEBUG oslo_concurrency.lockutils [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:06.466379 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: INFO nova.api.openstack.requestlog [None req-944166b0-f444-4ed5-b15e-8fc9e53827fa admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080374 Aug 24 05:44:06.466873 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: [pid: 112171|app: 0|req: 39/76] 10.222.0.73 () {60 vars in 1193 bytes} [Wed Aug 24 05:44:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:45:04.169496 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: Wed Aug 24 05:45:04 2022 - graceful shutdown triggered... Aug 24 05:45:04.170101 dv-cinder-854268-1-iscsi devstack@n-api.service[112171]: Gracefully killing worker 2 (pid: 112171)... Aug 24 05:45:04.170481 dv-cinder-854268-1-iscsi devstack@n-api.service[112170]: Gracefully killing worker 1 (pid: 112170)... Aug 24 05:45:04.171254 dv-cinder-854268-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 05:45:05.170132 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: worker 1 buried after 1 seconds Aug 24 05:45:05.170675 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: worker 2 buried after 1 seconds Aug 24 05:45:05.170675 dv-cinder-854268-1-iscsi devstack@n-api.service[112169]: goodbye to uWSGI. Aug 24 05:45:05.171745 dv-cinder-854268-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 05:45:05.172291 dv-cinder-854268-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 05:45:05.175122 dv-cinder-854268-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 05:45:05.184282 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 05:45:05.186886 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 05:45:05 2022] *** Aug 24 05:45:05.187526 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 05:45:05.187648 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 05:45:05.187757 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: nodename: dv-cinder-854268-1-iscsi Aug 24 05:45:05.187851 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: machine: x86_64 Aug 24 05:45:05.187960 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: clock source: unix Aug 24 05:45:05.188068 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: pcre jit disabled Aug 24 05:45:05.188167 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: detected number of CPU cores: 4 Aug 24 05:45:05.188289 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: current working directory: / Aug 24 05:45:05.188390 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: detected binary path: /usr/bin/uwsgi-core Aug 24 05:45:05.188491 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: your processes number limit is 47680 Aug 24 05:45:05.188623 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: your memory page size is 4096 bytes Aug 24 05:45:05.188623 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: detected max file descriptor number: 2048 Aug 24 05:45:05.188623 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: lock engine: pthread robust mutexes Aug 24 05:45:05.188903 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: thunder lock: enabled Aug 24 05:45:05.188998 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 05:45:05.189081 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 05:45:05.230122 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: Python main interpreter initialized at 0x56318c02b9c0 Aug 24 05:45:05.230122 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: python threads support enabled Aug 24 05:45:05.230122 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: your server socket listen backlog is limited to 100 connections Aug 24 05:45:05.230122 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: your mercy for graceful operations on workers is 90 seconds Aug 24 05:45:05.230538 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 05:45:05.230538 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: *** Operational MODE: preforking *** Aug 24 05:45:05.230845 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: *** uWSGI is running in multiple interpreter mode *** Aug 24 05:45:05.230845 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: spawned uWSGI master process (pid: 127171) Aug 24 05:45:05.231056 dv-cinder-854268-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 05:45:05.231649 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: spawned uWSGI worker 1 (pid: 127193, cores: 1) Aug 24 05:45:05.233108 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: spawned uWSGI worker 2 (pid: 127194, cores: 1) Aug 24 05:45:05.233108 dv-cinder-854268-1-iscsi devstack@n-api.service[127171]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 05:45:05.889903 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:45:05.891215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 05:45:07.044076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:45:07.044076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: from cryptography.utils import int_from_bytes Aug 24 05:45:07.044802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:45:07.044802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: from cryptography.utils import int_from_bytes Aug 24 05:45:07.045165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:45:07.045165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: from cryptography.utils import int_from_bytes Aug 24 05:45:07.045612 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 05:45:07.045612 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: from cryptography.utils import int_from_bytes Aug 24 05:45:09.444582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:45:09.445149 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:45:09.445426 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:45:09.445771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:45:09.446036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:45:09.446432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.446762 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.447087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.447410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.447900 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.448219 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.448547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.448872 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.449206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.449370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 05:45:09.449797 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.449893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 05:45:09.449979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.450167 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-1-iscsi {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.450261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 05:45:09.450444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.450553 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 05:45:09.450754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.450856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 05:45:09.451068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.451175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.451390 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.451574 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.451729 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.451828 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.452020 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.452122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.452338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.453064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.453370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.453490 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.453723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.454119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.454349 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.454486 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.454593 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.454784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.454947 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.455184 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.455304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.455513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.455630 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854268-1-iscsi {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.455830 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.455938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.456160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.456388 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.456560 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.456745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.456897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.457036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.457188 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.457339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.457489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.457670 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-1-iscsi {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.457842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.457992 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.458133 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.458280 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.458448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.458601 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.458822 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.458998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.459151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.459292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.459438 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.459577 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.460169 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.460339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.460481 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.460622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.460792 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.460946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.461093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.461233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.461381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.461532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.461724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.461872 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.461872 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.462158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854268-1-iscsi {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.462304 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.462444 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.462651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.462819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.462962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.463112 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.463261 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.463411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.463565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.463715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.463862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.463862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.464204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.464344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.464495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.464653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.464918 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.465366 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.465531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.465764 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.465924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.466074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.466233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.466489 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.466639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.466795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.466937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.467098 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.467251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.467390 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.467546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.467698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.467845 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.467993 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.468294 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.469068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.469227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.469376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.469525 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.469706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.469884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.470489 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.470649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.470802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.470943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.471089 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.471240 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.471380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.471538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.471695 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.471840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.471992 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.472150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.472300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.472448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.472448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.472723 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.472873 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.473020 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.473174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.473314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.473453 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.473617 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.473765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.473915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.474126 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.474274 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.474423 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.474571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.474719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.475053 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.475214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.475598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.475747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.475895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.476043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.476197 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.476356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.476522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.476826 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.476990 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.477140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.477289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.477289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.477602 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.477602 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.477887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.478038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.478222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.478415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.478646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.478646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.479070 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.479330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.479489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.479631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.479770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.479915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.480066 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.480682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.480844 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.480986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.481143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.481285 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.481424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.481594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.481750 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.481891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.482031 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.482182 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.482323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.482323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.483036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.483179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.483318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.483476 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.483625 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.483949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.484238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.484395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.484557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.484701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.484853 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.485001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.485232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.485402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.485810 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.486021 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.486187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.486330 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.486469 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.486622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.486782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.487022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.487185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.487327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.487474 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.487629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.487769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.487909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.488088 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.488242 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.488382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.488532 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.488680 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.488820 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.488968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.489145 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.489318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.489635 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.489788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.489931 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.490071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.490237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.490840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.490992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.491142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.491291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.491440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.491588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.491736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.491879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.492021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.492177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.492327 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.492475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.492633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.492781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.492922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.493076 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.493217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.493356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.493502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.493676 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.493868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.494100 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.494340 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.494523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.494721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.494883 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.495034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.495176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.495316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.495464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.495612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.496009 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.496173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.496317 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.496457 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.496605 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.496745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.496897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.497170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.497327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.497468 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.497638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.497786 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.497933 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.498086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.498227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.498374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.498522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.498670 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.498819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.498819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.499110 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.499261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.499464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.499723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.499880 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.500028 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 05:45:09.500176 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.500176 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.500442 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.501038 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.501206 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.501354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.501515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.501751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.501913 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.502069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.502209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.502358 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.502509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.502658 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.502805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.502958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.503105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.503254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.503417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.503560 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.503711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.503851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.504004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.504145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.504284 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.504284 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.504610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.504759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.504913 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.505054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.505201 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.505350 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.505497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.505671 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.505822 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.506206 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.506374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.506524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.506664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.506812 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.506961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.507140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.507386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.507532 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.507682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.507832 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.507972 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.508123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.508270 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.508417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.508558 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.508706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.508857 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.509004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.509153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.509293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.509497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.509971 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.510137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.510288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.510430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.510578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.510745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.511387 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.511530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.511670 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.511821 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.511980 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.512206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.512418 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.512716 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.512865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.513007 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.513155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.513311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.513311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.513607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.513755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.513895 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.514047 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.514201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.514342 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.514545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.514690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.514839 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.515532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.515695 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.515845 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.515985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.516144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.516555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.516714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.516856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.517003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.517142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.517294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.517623 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.517789 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.517789 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.518077 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.518218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.518366 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.518511 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.518663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.518803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.518951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.519090 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.519090 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.519382 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.519536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.519677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.519816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.520029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.520175 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.520325 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.520467 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.520607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.520752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.520920 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.521550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.521801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.521945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.522085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.522233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.522385 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.522527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.522698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.522698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.523055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.523195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.523341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.523484 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.523633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.523791 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.523943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.524083 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.524222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.524370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.524573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.524723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.524871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.525023 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.525254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.525669 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.525824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.525965 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.526114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.526254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.526393 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.526785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.526944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.527093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.527234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.527374 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.527513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.527789 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.527947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.528089 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.528237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.528387 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.528536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.528683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.528831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.528972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.529119 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.529119 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.529392 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.529392 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.529684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.529684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.529972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.530122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.530270 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.530410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.530556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.531800 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.531972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.531972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.532268 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.532425 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.532584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.532731 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.532902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.533157 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.533332 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.533487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.533656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.533805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.533964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.534120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.534274 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.534420 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.534565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.534765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.534917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.535073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.535236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.535394 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.535540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.535686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.535831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.535986 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.536134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.536280 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.536432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.536579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.536978 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.537147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.537304 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.537457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.537867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.538046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.538210 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.538366 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.538520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.538677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.538834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.538989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.539143 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.539298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.539454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.539608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.539754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.539910 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.540068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.540226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.540373 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.540519 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.540701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.540894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.541118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.541358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.542082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.542259 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.542423 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.542602 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.542758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.542907 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.543060 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.543323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.543487 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.543656 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.543843 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.544185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.544338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.544493 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.544640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.544851 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.545022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.545178 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.545324 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.545479 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.545748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.546001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.546160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.546379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.546537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.546693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.546854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.547316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.547483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.547645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.547791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.548073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.548237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.548385 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.548539 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.548687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.548842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.548997 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.549152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.549307 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.550169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.550333 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.550498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.550645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.550803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.550951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.551097 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.551251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.551406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.551552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.551732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.552439 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.552607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.552757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.552912 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.553122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.553292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.553543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.553789 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.553947 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.554094 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.554263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.554419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.554585 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.554911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.555073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.555228 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.555399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.555548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.555701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.555855 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.556002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.556155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.556343 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.556508 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.556743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.556980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.557225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.557674 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.557841 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.558000 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.558282 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.558282 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.558578 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.558578 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.558881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.559027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.559173 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.559173 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.559449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.559604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.559758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.559912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.560077 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.560225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.560369 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.560524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.560671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.560815 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.560967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.561120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.561276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.561422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.561610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.561765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.562900 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.563078 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.563240 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.563390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.563554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.563800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.563960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.564113 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.564274 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.564430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.564584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.564732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.564939 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.565095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.565313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.565467 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.565630 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.565793 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.566159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.566333 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.566492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.566647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.566811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.566968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.567114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.567269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.567428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.568001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.568161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.568303 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.568303 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.568665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.568777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.568892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.569001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.569109 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.569226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.569343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.569458 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.569637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.569904 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.570059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.573737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.574094 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.574267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.574461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.574636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.574803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.575043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.575296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.575474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.575630 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.575830 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.576000 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.576152 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.576305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.576305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.576595 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.576751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.576906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.577054 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.577207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.577361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.578691 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.578885 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.579070 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.579233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.579381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.579528 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.579683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.579831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.579976 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.580131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.580278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.580437 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.580599 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.580777 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.580952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.581128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.581277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.581432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.581661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.581828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.581984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.582150 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.582306 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.582460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.582621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.582767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.582919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.583123 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.583340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.584032 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.584283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.584447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.584609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.584794 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.584950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.585158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.585455 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.585656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.585951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586184 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586401 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586509 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586631 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.586966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587302 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587302 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587615 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587737 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.587737 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.588142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.588298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.588463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.588967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.589164 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.589329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.589477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.589648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.589799 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.589958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.590148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.590310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.590458 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.590605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.590751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.590898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.591053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.591208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.591395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.591553 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.591701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.591856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.592026 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.592174 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.592321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.592466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.592621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.592775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.593005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.593251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.593417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.593628 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.594276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.594530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.594709 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.594866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.594866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.595145 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.595356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.595519 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.595668 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.595822 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.595976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.596130 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.596277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.596430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.596585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.596749 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.596908 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.597062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.597208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.597368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.597368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.597368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.597809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.597957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.598103 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.598261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.598416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.598570 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.598735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.599212 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.599385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.599542 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.599699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.599848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.599848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.600126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.600281 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.600281 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.600568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.600568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.600852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.601010 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.601179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.601326 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.601473 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.601473 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.601793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.601941 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.602097 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.602252 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.602405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.602553 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.602706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.602866 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.603832 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.604502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.604754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.604917 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.605066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.605865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.606053 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.606205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.606354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.606510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.606657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.606819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.606819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.607120 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.607267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.607423 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.607576 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.607987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.608139 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.608294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.608449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.608449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.608809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.608995 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.609496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.609691 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.609841 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.609987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.610147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.610295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.610450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.610598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.610752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.610908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.611065 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.611213 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.611359 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.611520 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.611686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.611834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.611834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.612122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.612275 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.612429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.612591 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.612745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.612745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.613039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.613185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.613342 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.613510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.613768 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.613768 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.614050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.614637 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.614897 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.615053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.615210 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.615406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.615621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.615776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.615923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.616079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.616240 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.616445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.616607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.616762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.616918 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.617065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.617254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.617416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.618721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.618916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.619074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.619253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.619515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.619868 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.620050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.620209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.620365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.620522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.620678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.620833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.620999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.621278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.621439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.621728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.621893 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.622044 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.622204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.622358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.622506 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.622661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.622816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.622971 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.623126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.623291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.623454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.623602 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.623756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.623911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.624066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.624225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.625462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.625653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.625653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.626059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.626216 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.626362 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.626522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.626676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.626830 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.626978 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.627746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.627902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.628059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.628215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.628372 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.628520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.628677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.628825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.628825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.629344 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.629344 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.630005 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.630275 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.630446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.630595 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.630742 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.630899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.631048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.631194 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.631453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.631611 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.631767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.631923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.632078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.632225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.632391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.632547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.632547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.632847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.633001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.633156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.633302 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.633449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.633633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.633803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.633963 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.634111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.634264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.634421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.634579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.634579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.634866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.635013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.635700 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.635875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.636033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.636181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.636337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.636486 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.636633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.636789 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.636948 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.637104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.637252 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.637399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.637546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.637787 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.638085 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.638265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.638425 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.638582 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.638729 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.638889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.639048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.639211 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.639367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.639524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.639680 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.639835 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.641039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.641142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.641250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.641446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.641674 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.641828 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.641968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642258 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642765 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.642941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643031 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643644 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643727 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643823 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.643911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644084 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644438 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644578 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644863 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.644955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.645039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.645121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.645209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.645316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.645856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.645998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646186 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646271 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646887 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.646978 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647228 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647572 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.647934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648109 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.648982 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649152 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649608 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649872 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.649954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650045 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650211 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650477 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650568 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650652 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650741 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.650824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651425 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.651999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652081 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652437 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652528 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652612 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.652962 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.653066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.653190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.653308 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.653427 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.653538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.653723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.654424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.654570 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.654861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.654996 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.655135 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.655265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.655393 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.655535 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656030 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656307 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656575 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.656981 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.657107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.657278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.657407 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.657543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.657773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.658062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.658194 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.658322 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.658458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.658588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.658863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.658995 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659457 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.659912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660247 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660338 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660422 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660504 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660863 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.660947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661044 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661690 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661690 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.661922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662660 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662660 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662660 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.662974 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663270 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663380 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663534 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663797 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663893 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.663978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664070 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664252 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664435 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664569 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664750 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.664971 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.665066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.665248 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.665467 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.665664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.666318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.666563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.666563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.666931 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.667090 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.667262 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.667412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.667560 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.667707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.667861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.668009 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.668185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.668185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.668477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.668477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.668763 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.668917 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.669078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.669229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.669376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.669522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.669713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.669713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670612 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.670924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.671202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.671534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.671699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.671857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672013 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672273 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672342 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672656 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672803 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672880 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.672971 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673219 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673458 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.673909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674166 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674404 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674568 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674717 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.674852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675220 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675423 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675806 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.675977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676488 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676722 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676804 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.676957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677038 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677109 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677447 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677605 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677760 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.677911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678469 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678693 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678859 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.678967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679210 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679374 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679463 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679618 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679799 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.679945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680034 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680707 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.680960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.681037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.681037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.681204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.681204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.681497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.681753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.681864 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682252 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.682735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.683974 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684141 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684394 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684567 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.684994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685244 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685553 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685860 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.685954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686457 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686628 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686708 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.686787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.687409 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.687492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.687574 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.687655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.687859 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.687947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688342 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688808 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688900 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.688985 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689157 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689240 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689331 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689423 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.689775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690809 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.690996 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691171 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691253 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691425 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691889 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.691969 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692053 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692616 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.692964 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693129 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693210 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693781 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693873 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.693966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694218 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694308 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694567 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694797 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.694881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.695039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.695255 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.695425 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.695589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.695746 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.695924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.696107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.696259 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.696365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.696453 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.696527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.696614 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.696938 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.697055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.697150 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.697235 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.697462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.697775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.697892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.697979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.698094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.698324 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.698417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.698646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.698747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.698958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.699050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.699299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.699390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.699633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.699732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.699952 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.700042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.700272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.700376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.700587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.700684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.700901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.700998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.701219 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.701318 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.701529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.701753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.701893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.701983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.702187 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.702322 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.702587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.703185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.703450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.703551 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.703767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.703871 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.704087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.704179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.704402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.704491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.704716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.704809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.705029 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.705133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.705340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.705442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.705682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.705791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.706014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.706114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.706322 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.706419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.706643 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.706760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.706961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.707059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.707276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.707390 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.707598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.707705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.707911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.708004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.708220 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.708326 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.708542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.708635 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.708851 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.708944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.709161 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.709264 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.709470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.709636 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.709805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.709912 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.710116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.710214 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.710430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.710532 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.710740 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.710839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.711050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.711145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.711364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.711465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.711677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.711787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.712001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.712105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.712315 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.712449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.712625 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.712738 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.712949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.713045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.713276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.713378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.713624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.713734 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.713954 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.714054 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.714296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.714389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.714615 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.714729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.714928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.715027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.715235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.715326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.715485 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:45:09.715668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 05:45:09.715759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127193) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 05:45:09.793249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO dbcounter [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Registered counter for database nova_api Aug 24 05:45:09.802073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO dbcounter [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Registered counter for database nova_api Aug 24 05:45:09.815618 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_db.sqlalchemy.engines [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:09.823623 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writer thread running {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:09.823847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_db.sqlalchemy.engines [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:09.833061 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writer thread running {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:09.881295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.context [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96507276-ed40-4723-bde2-cb864799ff28(cell1) {{(pid=127193) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:45:09.885448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:09.885958 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:09.887526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:09.888269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:09.888713 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:09.891294 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:09.893308 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO dbcounter [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Registered counter for database nova_cell0 Aug 24 05:45:09.894079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.context [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96507276-ed40-4723-bde2-cb864799ff28(cell1) {{(pid=127194) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 05:45:09.897416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO dbcounter [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Registered counter for database nova_cell1 Aug 24 05:45:09.898203 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:09.898686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:09.900266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:09.901027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:45:09.901550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:45:09.903854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:45:09.904424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_db.sqlalchemy.engines [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:09.906056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO dbcounter [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Registered counter for database nova_cell0 Aug 24 05:45:09.906823 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_db.sqlalchemy.engines [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:09.910731 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO dbcounter [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Registered counter for database nova_cell1 Aug 24 05:45:09.912339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writer thread running {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:09.917296 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writer thread running {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:09.918604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_db.sqlalchemy.engines [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:09.920299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_db.sqlalchemy.engines [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:09.926782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writer thread running {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:09.928894 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writer thread running {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:10.061433 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO dbcounter [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Registered counter for database nova_cell0 Aug 24 05:45:10.068809 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_db.sqlalchemy.engines [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127193) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:10.073197 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writer thread running {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:10.076087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO dbcounter [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Registered counter for database nova_cell0 Aug 24 05:45:10.083054 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_db.sqlalchemy.engines [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 05:45:10.087409 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writer thread running {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 05:45:10.404327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: WARNING keystonemiddleware.auth_token [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:45:10.408871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: WARNING keystonemiddleware.auth_token [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:45:10.411684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: WARNING keystonemiddleware.auth_token [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:45:10.416159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: WARNING keystonemiddleware.auth_token [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:45:10.761865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: WARNING keystonemiddleware.auth_token [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:45:10.766962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: WARNING keystonemiddleware.auth_token [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 05:45:10.768408 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: WARNING keystonemiddleware.auth_token [None req-0eb1e29b-494d-42d8-88d8-a7d07b5312ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:45:10.773521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: WARNING keystonemiddleware.auth_token [None req-574a683a-50e4-48dd-bee5-f3d27aedfcf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 05:45:10.774340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56318c02b9c0 pid: 127193 (default app) Aug 24 05:45:10.779035 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56318c02b9c0 pid: 127194 (default app) Aug 24 05:45:46.604321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:46.607208 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:46.610899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:46.611623 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:48.123145 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-336b1329-32cf-482c-867f-51722b9c5075 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Action: 'create', calling method: .version_select at 0x7fa91e2cb5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1181773277", "metadata": {"Type": "work"}}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:45:50.071923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-336b1329-32cf-482c-867f-51722b9c5075 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.487298 Aug 24 05:45:50.072698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 05:45:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3491 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 05:45:50.093893 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.096121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.098340 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.105816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:45:50.539569 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5e997653-d0a7-48e7-a38a-ad0bf279589c tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e318280>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:51.403964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5e997653-d0a7-48e7-a38a-ad0bf279589c tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 200 len: 354 microversion: 2.1 time: 1.320008 Aug 24 05:45:51.410927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 1/2] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:45:50 2022] GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 354 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:45:51.420973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e8048213-3348-4f8c-9f4f-067f5485887b tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e1a04c0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:51.735577 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e8048213-3348-4f8c-9f4f-067f5485887b tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 200 len: 354 microversion: 2.1 time: 0.319758 Aug 24 05:45:51.736051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:45:51 2022] GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 354 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:51.751483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-04715243-58c5-42e7-972e-ee33c909cb33 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e1de4c0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:51.931747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-04715243-58c5-42e7-972e-ee33c909cb33 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 202 len: 0 microversion: 2.1 time: 0.185051 Aug 24 05:45:51.932585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:45:51 2022] DELETE /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:45:51.941635 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-38e4320e-a1ab-49a7-9667-d0987c2ff509 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e1a0b80>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:52.009834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-38e4320e-a1ab-49a7-9667-d0987c2ff509 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 200 len: 353 microversion: 2.1 time: 0.072301 Aug 24 05:45:52.011027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 3/5] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:45:51 2022] GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:53.024241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-50c36278-278e-4aa3-b352-e7ebad759c6c tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e1deb80>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:53.162815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-50c36278-278e-4aa3-b352-e7ebad759c6c tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 200 len: 353 microversion: 2.1 time: 0.142522 Aug 24 05:45:53.169203 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 3/6] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:45:53 2022] GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:54.182316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-998b8156-8e61-4638-8f40-b1f05742b7f4 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e1b5280>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:54.327755 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-998b8156-8e61-4638-8f40-b1f05742b7f4 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 200 len: 353 microversion: 2.1 time: 0.151147 Aug 24 05:45:54.330010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:45:54 2022] GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:55.342805 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0e13c550-1a3f-4c8c-a74d-c04f389561df tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e1dedc0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:55.486132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0e13c550-1a3f-4c8c-a74d-c04f389561df tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 200 len: 353 microversion: 2.1 time: 0.140028 Aug 24 05:45:55.486132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:45:55 2022] GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:45:56.499379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b26ed81c-845c-432c-a04d-b19dd70fa523 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Calling method '.version_select at 0x7fa91e1a0c10>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:45:56.585891 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-b26ed81c-845c-432c-a04d-b19dd70fa523 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] HTTP exception thrown: Volume 97d4a753-d44b-4020-9437-40a38e0d42b9 could not be found. Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b26ed81c-845c-432c-a04d-b19dd70fa523 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Request method failure captured: Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 HTTP/1.1 Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsK18-WM6gkq1NFZAY2uVV1b7c3s5eV0j7t_JsHdA5_F31WGmrdriJqLqCDJey5vajBGBFf_OcTzYmzziurYn8Ifh3r9G8-uBMzfaiwkJlpzsbtX3290v_9Cx4UszDgHbAofI2VgIbU-aVyoZ90zlEy5Coxt4ZpIU1R7dw4UQkFK9s Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: f4e9d8728a874a9aae02f347cde0467f Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-VolumesGetTestJSON-43116877 Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:45:56.590320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_f4e9d8728a874a9aae02f347cde0467f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/f4e9d8728a874a9aae02f347cde0467f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4e9d8728a874a9aae02f347cde0467f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/f4e9d8728a874a9aae02f347cde0467f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-VolumesGetTestJSON-43116877 Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: f4e9d8728a874a9aae02f347cde0467f Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-VolumesGetTestJSON-43116877 Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-VolumesGetTestJSON-43116877-project Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 8c0f1c3464114a19963d956c66046018 Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-VolumesGetTestJSON-43116877-project Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Volume 97d4a753-d44b-4020-9437-40a38e0d42b9 could not be found. Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '97d4a753-d44b-4020-9437-40a38e0d42b9'} Aug 24 05:45:56.591417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 97d4a753-d44b-4020-9437-40a38e0d42b9 could not be found. (HTTP 404) (Request-ID: req-35f18ef2-a507-49ea-b828-89426f03de94) Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:45:56.592143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:45:56.593054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 97d4a753-d44b-4020-9437-40a38e0d42b9 could not be found. Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:45:56.594181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 97d4a753-d44b-4020-9437-40a38e0d42b9 could not be found. Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 97d4a753-d44b-4020-9437-40a38e0d42b9 could not be found. Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b26ed81c-845c-432c-a04d-b19dd70fa523 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] Returning 404 to user: Volume 97d4a753-d44b-4020-9437-40a38e0d42b9 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:45:56.595146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b26ed81c-845c-432c-a04d-b19dd70fa523 tempest-VolumesGetTestJSON-43116877 tempest-VolumesGetTestJSON-43116877-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9" status: 404 len: 109 microversion: 2.1 time: 0.102834 Aug 24 05:45:56.596269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 5/9] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:45:56 2022] GET /compute/v2.1/os-volumes/97d4a753-d44b-4020-9437-40a38e0d42b9 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:00.178445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9dbdeb31-bd5e-4487-b5b3-07cd6354c53b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'create', calling method: .version_select at 0x7fa91e1de700>, body: {"keypair": {"name": "tempest-keypair-1363600537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAVJBIMvda+TOJdtFgvnMI+ZJqqcNlKLhNZSWGdlNoQK0UFSkETVvXjdZ5zNLyM1SfMnvEvpUCbN7r5sqjqQ5fguh62cou0cDWZsp6GrA+fgoMmUiJsWtZwAlhUHBzDBA=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:00.277471 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-9dbdeb31-bd5e-4487-b5b3-07cd6354c53b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for project 47156a6d045b4147a837fbf132421a53. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:00.289943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-9dbdeb31-bd5e-4487-b5b3-07cd6354c53b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for user 0b18352a23444324b27d17d2cee636fc and project 47156a6d045b4147a837fbf132421a53. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:00.403395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9dbdeb31-bd5e-4487-b5b3-07cd6354c53b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.489642 Aug 24 05:46:00.404279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 5/10] 10.222.0.73 () {62 vars in 1200 bytes} [Wed Aug 24 05:45:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 491 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 05:46:02.505132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-108979049", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "networks": [{"uuid": "192c2a3e-4369-42cb-aa57-f99b2028101a"}]}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:02.660187 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] validate_networks() for [('192c2a3e-4369-42cb-aa57-f99b2028101a', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:03.677787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-987cc5cd-240c-42cf-b4ff-64bf260fc114 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: .version_select at 0x7fa91e1891f0>, body: {"keypair": {"name": "tempest-keypair-290544723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcO7NHxNtwh6RjmF89eQeNoY5hXroWS8aGEDQzOWy2i9ft4bMHgeGa4cHVUCjk98ybmOrcLoF48OpGpnCi+cIUWI2pC2QrMK2SVtvI+oMzAFpiC/0B0RrKmnYjIJLlz5A=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:03.697419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-987cc5cd-240c-42cf-b4ff-64bf260fc114 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:03.701491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-987cc5cd-240c-42cf-b4ff-64bf260fc114 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:03.763008 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-987cc5cd-240c-42cf-b4ff-64bf260fc114 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.224920 Aug 24 05:46:03.763959 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 6/11] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:46:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:03.979023 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9dabcf1b-a350-421f-8dcf-38f3894948f9 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91e189940>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:04.137413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9dabcf1b-a350-421f-8dcf-38f3894948f9 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/39a3e2e1-07b5-497b-9495-6dd9a8c4d115" status: 200 len: 351 microversion: 2.1 time: 0.163363 Aug 24 05:46:04.138101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 7/12] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:46:03 2022] GET /compute/v2.1/os-volumes/39a3e2e1-07b5-497b-9495-6dd9a8c4d115 => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:05.393535 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-822929668", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:05.537275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] validate_networks() for [('62c4e1e9-8d68-4a3b-82b7-dbed6a218e84', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:05.699573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:05.701902 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:05.702578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:05.704578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:05.705483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:05.731129 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.731627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.741083 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.742303 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:05.742786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:05.750728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:05.846764 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Getting quotas for project caf4c294b65d453d8d0b9cd6fcd76976. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:05.867478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Getting quotas for user 914bea2efd334e6c8dc31698dfabbf8e and project caf4c294b65d453d8d0b9cd6fcd76976. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:05.902526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:05.913286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:06.090139 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-51ec54c3-c3cb-42ea-8489-f7c51859e3c4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.782464 Aug 24 05:46:06.097782 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 6/13] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:46:06.108635 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1624172581", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cb66fbe-84cf-4e7a-9635-478f9b0fa356"}], "security_groups": [{"name": "tempest-securitygroup--57803077"}], "key_name": "tempest-keypair-1363600537", "user_data": "}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:06.417486 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] validate_networks() for [('5cb66fbe-84cf-4e7a-9635-478f9b0fa356', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:06.668464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:06.678383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:06.679190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:06.679867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:06.680502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:06.695361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:06.697370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:06.697928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:06.699239 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:06.703033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:06.703709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:06.778270 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for project 3726a58288d9455b97e041a2e92f8850. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:06.791613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for user 3d8467cc62d948038690af1fdf5bb96a and project 3726a58288d9455b97e041a2e92f8850. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:06.822359 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:06.832612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:07.076711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3091682a-8235-4e8c-b699-60a38bae9bd4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.808765 Aug 24 05:46:07.077542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 8/14] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:46:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 05:46:07.107983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-740fb755-4f61-4d33-bc7c-b60400a63ebd tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:07.109471 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-740fb755-4f61-4d33-bc7c-b60400a63ebd tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:07.329427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-740fb755-4f61-4d33-bc7c-b60400a63ebd tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:07.359955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-740fb755-4f61-4d33-bc7c-b60400a63ebd tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1214 microversion: 2.1 time: 0.267039 Aug 24 05:46:07.360556 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 9/15] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:07 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1214 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:07.380426 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c568003b-6af5-43eb-b520-94cc859d5ea1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:07.385780 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c568003b-6af5-43eb-b520-94cc859d5ea1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:07.506382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c568003b-6af5-43eb-b520-94cc859d5ea1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:07.519945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c568003b-6af5-43eb-b520-94cc859d5ea1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1221 microversion: 2.1 time: 0.143739 Aug 24 05:46:07.521107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 10/16] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:07 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1221 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:07.555183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:07.555751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:07.556406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:07.558426 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:07.559045 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:07.572938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.573811 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.574410 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.575715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:07.576885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:07.577495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:07.608304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for project 47156a6d045b4147a837fbf132421a53. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:07.623627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for user 0b18352a23444324b27d17d2cee636fc and project 47156a6d045b4147a837fbf132421a53. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:07.628563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-485872866", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:07.641435 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:07.644065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:07.740451 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] validate_networks() for [('62c4e1e9-8d68-4a3b-82b7-dbed6a218e84', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:07.750003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2b893470-77c4-459b-91fb-1895bbbf9352 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.656769 Aug 24 05:46:07.751203 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 7/17] 10.222.0.73 () {62 vars in 1188 bytes} [Wed Aug 24 05:46:06 2022] POST /compute/v2.1/servers => generated 400 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 05:46:07.763063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-23a90334-29b8-49b3-b6f3-55adf28f933e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:07.764645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-23a90334-29b8-49b3-b6f3-55adf28f933e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:07.976143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-23a90334-29b8-49b3-b6f3-55adf28f933e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:08.023544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-23a90334-29b8-49b3-b6f3-55adf28f933e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:08.026177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-23a90334-29b8-49b3-b6f3-55adf28f933e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:08.028210 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-23a90334-29b8-49b3-b6f3-55adf28f933e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1282 microversion: 2.20 time: 0.268963 Aug 24 05:46:08.030034 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 8/18] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:07 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1282 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:08.118579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1241181086", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7299e068-1622-4d4b-9084-04ba950ea9f9"}], "security_groups": [{"name": "tempest-securitygroup--1906696202"}], "key_name": "tempest-keypair-290544723", "user_data": "}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:08.373794 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] validate_networks() for [('7299e068-1622-4d4b-9084-04ba950ea9f9', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:08.743547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:08.750369 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:08.752028 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:08.753893 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:08.754542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:08.766586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.766925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.768713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.771072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.771765 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.775462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.825207 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for project 3726a58288d9455b97e041a2e92f8850. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:08.832293 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for user 3d8467cc62d948038690af1fdf5bb96a and project 3726a58288d9455b97e041a2e92f8850. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:08.847365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:08.850190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:08.902456 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-510949dd-2e42-4164-9462-a141fd64aea3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.279454 Aug 24 05:46:08.903671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 11/19] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:46:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 05:46:08.908558 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:08.909453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:08.916696 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.917459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.918069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.918911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.919512 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.920179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.939269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:08.939881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:08.940379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:08.940885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:08.941495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:08.953802 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.955132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.955798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.956681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:08.957272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:08.957930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:08.977152 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:08.981521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:08.997249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:09.000220 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:09.084476 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-488378e8-d7db-4b9f-9b06-7f3bb3803dd9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.970304 Aug 24 05:46:09.091363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 9/20] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:46:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:46:09.097035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-611b45eb-ba56-42b6-acbf-88dd21ddfc67 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:09.097621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-611b45eb-ba56-42b6-acbf-88dd21ddfc67 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:09.105713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:09.131481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-99a73a31-6483-48d7-ae30-8d7fc11a228b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1218 microversion: 2.1 time: 0.225276 Aug 24 05:46:09.132199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 12/21] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:08 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1218 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:09.138244 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:09.139417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:09.180546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.180804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.181255 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:09.183762 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:09.184258 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:09.188350 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:09.214032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-611b45eb-ba56-42b6-acbf-88dd21ddfc67 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:09.226083 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-611b45eb-ba56-42b6-acbf-88dd21ddfc67 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1221 microversion: 2.1 time: 0.132915 Aug 24 05:46:09.227262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 10/22] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:09 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1221 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:09.232168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d0c3f364-7ef5-46d0-b826-33e93494ce2e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:09.236281 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d0c3f364-7ef5-46d0-b826-33e93494ce2e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:09.330368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d0c3f364-7ef5-46d0-b826-33e93494ce2e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:09.339075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:09.348460 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d0c3f364-7ef5-46d0-b826-33e93494ce2e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1241 microversion: 2.1 time: 0.119703 Aug 24 05:46:09.351801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 11/23] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:09 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:09.369738 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:09.375091 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:09.376416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bf65fa51-6ff4-46d1-8042-8e91d789225b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1286 microversion: 2.20 time: 0.243296 Aug 24 05:46:09.377515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 13/24] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:09 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1286 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:10.158331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:10.159686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:10.174786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.175585 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.176175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.177085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.179119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.179764 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.248984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:10.249899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:10.261277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.264671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.265672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.267235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.270525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.272980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.566801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:10.589449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0a4b98c9-ff15-4499-a523-21a67584802a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1210 microversion: 2.1 time: 0.435911 Aug 24 05:46:10.609369 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 12/25] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:10 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1210 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:10.619185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:10.619842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:10.623495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:10.661820 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.662637 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.663235 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.664401 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.665707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.666367 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.700672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-42210357-d9fd-4f9b-afa1-bf5786f6a7cb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1225 microversion: 2.1 time: 0.455743 Aug 24 05:46:10.712507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 14/26] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:10 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1225 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:10.777787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:10.784817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:10.800633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:10.809385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.812364 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.812810 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.817153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:10.818940 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:10.819534 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:10.820250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2df21731-dd99-4bac-b956-d27f0af08fed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1237 microversion: 2.1 time: 0.209460 Aug 24 05:46:10.821073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 13/27] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:10 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1237 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:10.827016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-66fd135b-8968-42d5-b5af-358de96f2ba2 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91cf80ee0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:11.122022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-66fd135b-8968-42d5-b5af-358de96f2ba2 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/6ee66070-3962-40f4-9fce-a9d9e6072888" status: 200 len: 351 microversion: 2.1 time: 0.299601 Aug 24 05:46:11.123282 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 14/28] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:46:10 2022] GET /compute/v2.1/os-volumes/6ee66070-3962-40f4-9fce-a9d9e6072888 => generated 351 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:11.279987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:11.306433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:11.306433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:11.306433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-268fd2c2-5b63-4f79-9091-93723dcbe016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1334 microversion: 2.20 time: 0.555041 Aug 24 05:46:11.306661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 15/29] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:10 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1334 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:11.630716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:11.631373 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:11.647582 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.652822 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.654640 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.655454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.661694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.663749 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.752554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:11.753175 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:11.760739 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.761229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.761692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.767086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.767743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.768487 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.881714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:11.891514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f48a9ef9-08a1-40b0-a635-18d32dfcf8e8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1274 microversion: 2.1 time: 0.264840 Aug 24 05:46:11.899404 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:11.900357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 15/30] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:11 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1274 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:11.921795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-372859d9-c1f3-486a-bc91-f62d940dbd7f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1273 microversion: 2.1 time: 0.172950 Aug 24 05:46:11.933592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 16/31] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:11 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:11.946994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:11.947681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:11.975116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.977050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.979633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:11.986022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:11.988345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:11.989986 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.150894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:12.162448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-eccb565e-fc73-4f84-b331-ff60c78add04 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1293 microversion: 2.1 time: 0.231794 Aug 24 05:46:12.164108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 16/32] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:11 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1293 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:12.327166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:12.327784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:12.340025 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.340510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.341543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.342584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.343675 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.344123 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.416273 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:12.428710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:12.430822 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:12.432056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ea662095-74ee-48fd-afab-51b070fdda3e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1340 microversion: 2.20 time: 0.109658 Aug 24 05:46:12.438817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 17/33] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:12 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:12.926288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:12.926911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:12.933533 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.934050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.934677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.935413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.937272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.937784 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.950842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:12.951748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:12.959404 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.961402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.962051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:12.963236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:12.963865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:12.964642 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:13.040510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.049516 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b2b17c07-53d0-43f2-8a65-cbcd8c8804ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1274 microversion: 2.1 time: 0.127067 Aug 24 05:46:13.050148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 17/34] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:12 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:13.061749 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.066704 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b789c8e2-4bdb-4f9f-84ab-a1438b2099be tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1273 microversion: 2.1 time: 0.120493 Aug 24 05:46:13.068202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 18/35] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:12 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:13.184703 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:13.185434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:13.191672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:13.192160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:13.192756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:13.193292 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:13.193775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:13.194358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:13.315018 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.323617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9275df10-b261-45d6-9abd-5f905b25ff17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1293 microversion: 2.1 time: 0.142942 Aug 24 05:46:13.324389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 18/36] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:13 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:13.456261 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:13.457408 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:13.464742 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:13.465495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:13.466407 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:13.467513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:13.468267 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:13.468870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:13.534361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.542944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.544937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:13.546210 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d3389c6a-0bad-41a5-86a1-da8ddfe4521a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1340 microversion: 2.20 time: 0.094896 Aug 24 05:46:13.557605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 19/37] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:13 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1340 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:14.078605 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:14.079237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:14.087863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:14.088536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:14.094530 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.095017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.095138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.095448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.095694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.096021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.096719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.097179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.097632 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.100614 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.101103 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.103075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.197751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.198681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.206436 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-70f9fee0-d685-4c6a-86c4-9b2ddcd56611 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1273 microversion: 2.1 time: 0.123243 Aug 24 05:46:14.207994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 20/38] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:14 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:14.208940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-cf9d4b98-aeee-4e39-81d5-2f1dc888bb51 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1274 microversion: 2.1 time: 0.136756 Aug 24 05:46:14.228482 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 19/39] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:14 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:14.344917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:14.346183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:14.352709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.353187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.353832 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.355924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.356415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.356849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.422458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.431096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ab17d268-a59a-4893-8fff-f9c4f3f8005e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1293 microversion: 2.1 time: 0.090668 Aug 24 05:46:14.431951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 21/40] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:14 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:14.570655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:14.571281 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:14.578047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.578531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.578966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.579674 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:14.580127 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:14.580673 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:14.761193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.778407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.782470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:14.784377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-54edb4dc-f424-4dd0-beb2-d2a159312623 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1340 microversion: 2.20 time: 0.218493 Aug 24 05:46:14.790379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:14 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1340 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:15.230658 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:15.232037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:15.242058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:15.243194 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:15.258515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.263167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.266041 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.268763 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.270128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.272092 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.280124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.280899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.283834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.286756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.288769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.289243 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.627032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:15.638832 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3c9d66ab-0b04-42e0-9bf4-c5ccaddc39eb tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1272 microversion: 2.1 time: 0.403159 Aug 24 05:46:15.645359 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 21/42] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:15 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1272 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:15.673487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d286c891-9a01-49c8-9590-d3a690af7420 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91cf2f940>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:15.732220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:15.754817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4b032f28-f8b1-4907-af74-3e2e575e7df0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1281 microversion: 2.1 time: 0.525769 Aug 24 05:46:15.755609 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 22/43] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:15 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1281 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:15.765338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:15.766348 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:15.778128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.778612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.784292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.784292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.784751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.785188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.801428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d286c891-9a01-49c8-9590-d3a690af7420 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0ee7cf43-52f9-4c9c-9da4-26a60f97e8bd" status: 200 len: 350 microversion: 2.1 time: 0.152201 Aug 24 05:46:15.802701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 22/44] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:46:15 2022] GET /compute/v2.1/os-volumes/0ee7cf43-52f9-4c9c-9da4-26a60f97e8bd => generated 350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:15.816146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:15.817975 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:15.834699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.835598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.836286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:15.839142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:15.840972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:15.843085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:16.069798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:16.080352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-68c5ed78-c7ab-467a-836c-889436405d73 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1299 microversion: 2.1 time: 0.323649 Aug 24 05:46:16.085307 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 23/45] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:15 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1299 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:16.101747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9b9f3372-ebbe-4b54-88a9-1863c8c29bf5 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91c713160>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:16.265319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9b9f3372-ebbe-4b54-88a9-1863c8c29bf5 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.176786 Aug 24 05:46:16.275991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 24/46] 10.222.0.73 () {58 vars in 1134 bytes} [Wed Aug 24 05:46:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:16.283690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4e2663cc-56e6-4279-85c3-c193d6b31824 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91c771ca0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:16.307821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:16.330116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:16.331593 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:16.332900 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6f2c674e-4b79-4cac-81c8-a1d726f24f25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1340 microversion: 2.20 time: 0.524599 Aug 24 05:46:16.348286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:15 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1340 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:16.395755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4e2663cc-56e6-4279-85c3-c193d6b31824 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.118290 Aug 24 05:46:16.405525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 25/48] 10.222.0.73 () {58 vars in 1149 bytes} [Wed Aug 24 05:46:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:16.410613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e096cb1a-f819-4445-b4af-19e440221ed8 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91cf2ff70>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:16.604492 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e096cb1a-f819-4445-b4af-19e440221ed8 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.198008 Aug 24 05:46:16.605241 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 24/49] 10.222.0.73 () {58 vars in 1134 bytes} [Wed Aug 24 05:46:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:16.619007 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ad375490-2e74-4fce-904d-b409934d66a4 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91d877ee0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:16.671720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:16.672408 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:16.694742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:16.695165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:16.695669 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:16.698988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:16.699468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:16.704932 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:16.826651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ad375490-2e74-4fce-904d-b409934d66a4 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.211752 Aug 24 05:46:16.828009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 26/50] 10.222.0.73 () {58 vars in 1167 bytes} [Wed Aug 24 05:46:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:16.837696 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:16.838564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:16.856343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:16.857680 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:16.862113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:16.864851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:16.865356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:16.865825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.132643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.146542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d1d16ebd-4a4d-4883-b4bc-dd186ecb2a37 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1279 microversion: 2.1 time: 0.313674 Aug 24 05:46:17.148939 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 27/51] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:16 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1279 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:17.167669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-eb0e2571-5553-4bfe-b8ab-d76d4bd48db5 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91eb788b0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:17.392626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-eb0e2571-5553-4bfe-b8ab-d76d4bd48db5 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.241861 Aug 24 05:46:17.393626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 28/52] 10.222.0.73 () {58 vars in 1170 bytes} [Wed Aug 24 05:46:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:17.398458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:17.404885 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:17.419201 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:17.420830 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:17.421740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.427315 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:17.428032 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:17.428686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.473398 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.486818 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-14115282-1eea-40fd-8716-248b816f2915 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1272 microversion: 2.1 time: 0.818054 Aug 24 05:46:17.489549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 25/53] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:16 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1272 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:17.498897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:17.505946 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:17.516478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:17.524450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:17.525624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.526634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:17.527311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:17.528315 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:17.679428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.699984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.702335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.703532 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-382065b5-97a2-4d0e-8ab9-047330af04c6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1340 microversion: 2.20 time: 0.212756 Aug 24 05:46:17.712613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 26/54] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:17 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1340 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:17.723897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-69c11735-b221-48bc-a4f1-f8c058f222b6 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91cf22af0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:17.761610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:17.788932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d028aadf-2cb7-4f9e-a534-e0cd73bedd53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1299 microversion: 2.1 time: 0.394345 Aug 24 05:46:17.799483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 29/55] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:17 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1299 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:17.956831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-69c11735-b221-48bc-a4f1-f8c058f222b6 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.236849 Aug 24 05:46:17.957412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 27/56] 10.222.0.73 () {58 vars in 1155 bytes} [Wed Aug 24 05:46:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:17.971471 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5c740817-04f0-4e03-8244-467b44420e1c tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91c713040>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:18.175118 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:18.176023 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:18.189311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5c740817-04f0-4e03-8244-467b44420e1c tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.221326 Aug 24 05:46:18.190475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 30/57] 10.222.0.73 () {58 vars in 1188 bytes} [Wed Aug 24 05:46:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:18.196399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.208557 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.210121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.211321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.212154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.212816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.220572 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9273d3a7-2936-4e76-829b-8aa7b7f82b46 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] Calling method '.version_select at 0x7fa91c7a3550>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:18.432113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9273d3a7-2936-4e76-829b-8aa7b7f82b46 tempest-VolumesTestJSON-563336969 tempest-VolumesTestJSON-563336969-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.224856 Aug 24 05:46:18.433609 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 31/58] 10.222.0.73 () {58 vars in 1155 bytes} [Wed Aug 24 05:46:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:18.514606 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:18.521963 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:18.523001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:18.539995 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1ed5ccce-8962-4027-963d-88b31b72cabc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1279 microversion: 2.1 time: 0.363351 Aug 24 05:46:18.543185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.543681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.544121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.544948 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.545405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.545863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.547087 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 28/59] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:18 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:18.760079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:18.760643 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:18.778518 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.782938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.782938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.782938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:18.783330 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:18.784014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:18.799487 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=4 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:18.842829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=24 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:18.966839 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=6 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.140569 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.165195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-769cf3d8-855d-4fd5-8778-2330ece5be85 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.653685 Aug 24 05:46:19.168030 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 32/60] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:18 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:19.184319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:19.187483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:19.205465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.208549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.210047 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.211017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.212702 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.218728 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.318017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.321714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.327280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-753c94ff-13bc-4b2b-abca-3b0dbc6b2266 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1299 microversion: 2.1 time: 0.157865 Aug 24 05:46:19.332152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 33/61] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:19 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:19.334846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=24 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.388349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.398493 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.400121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.401250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f96fc183-a313-4616-887f-b4dbb4f8ab35 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.662721 Aug 24 05:46:19.406432 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 29/62] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:18 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:19.562782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:19.564884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:19.574725 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.575811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.577150 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.578111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.578910 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.579992 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.782017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.796611 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-17abfd0c-8ece-46a7-82d6-f89d1deda5c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.241678 Aug 24 05:46:19.797209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 34/63] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:19 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:20.188347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:20.189606 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:20.195508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.196257 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.203102 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.203883 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.204356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.204786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.352218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:20.352913 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:20.356114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.360854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.361420 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.362308 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.363114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.363653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.364212 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.420862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:20.430484 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c31fa991-fc11-42df-8f59-9ee9c6f0e36f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.245861 Aug 24 05:46:20.431058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 30/64] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:20 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:20.436006 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:20.437147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:20.444496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.445298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.445853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.446835 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.447328 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.447930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.479871 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:20.566655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:20.577265 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-60321f72-329e-4d7f-a8ea-ae9e18f2f2d3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.228708 Aug 24 05:46:20.596313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 35/65] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:20 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:20.677436 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:20.687045 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:20.694648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:20.695807 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bb37ca54-a922-4fd6-a7dd-05d8867cc400 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.263684 Aug 24 05:46:20.705636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 31/66] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:20 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:20.818949 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:20.819589 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:20.832375 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.832795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.833232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.834117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.834580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.836230 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.016087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:21.030562 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cbaa4360-e4a8-4316-8827-ea38e01c0fd8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.214000 Aug 24 05:46:21.036380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 36/67] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:20 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:21.455290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:21.456358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:21.462994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.463839 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.465271 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.466173 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.467352 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.468104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.610239 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:21.611295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:21.624346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.624841 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.625392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.627062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.627424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.629894 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.675693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:21.691120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a11ddcc9-d3bb-458e-ac1b-f0ca494e01f0 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.240272 Aug 24 05:46:21.691746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 32/68] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:21 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:21.723288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:21.724165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:21.736345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:21.738262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.738846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.739433 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.740339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.740797 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.741225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.881172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:21.894773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-97061ff5-6273-44af-af7b-0360eb999638 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.289415 Aug 24 05:46:21.914571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 37/69] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:21 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:21.993759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:22.003774 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:22.005375 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:22.006549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-344caebd-9a22-4cc6-aa94-6b31dcb28c1e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.287613 Aug 24 05:46:22.007276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 33/70] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:21 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:22.058982 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:22.059800 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:22.066951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.067440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.067951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.068543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.068985 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.069399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.245984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:22.256199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a7dcc82f-9c44-43ef-bfe9-e9bdbc2b17d5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.201004 Aug 24 05:46:22.256783 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 38/71] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:22 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:22.713050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:22.713830 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:22.720748 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.721236 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.722943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.723703 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.724173 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.724603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.915903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:22.916507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:22.923300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.923856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.924355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.925137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.925867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.926379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.138628 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:23.152934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-08725743-cd51-423d-8487-3af2bdb277e5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.443614 Aug 24 05:46:23.154546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 34/72] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:22 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:23.174126 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:23.175630 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:23.207596 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.208663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.209536 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.210928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.211843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.212711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.417181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:23.434916 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-94c3eb4b-7626-4058-a16d-d40f85bf359e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.522732 Aug 24 05:46:23.453647 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 39/73] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:22 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:23.460554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:23.461599 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:23.470865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.471705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.472295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.473178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.475237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.476062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.563548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:23.609147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:23.612052 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:23.614161 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fe683d51-4a04-4328-8c2b-60909a42f188 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.447593 Aug 24 05:46:23.628871 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 35/74] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:23 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:23.769108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:23.781534 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-850bfcb2-edf4-4c88-9f8b-cbf6a570ae8f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.326415 Aug 24 05:46:23.782155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 40/75] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:23 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:24.176119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:24.176736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:24.189128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.189743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.190196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.193109 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.193648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.194384 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.406031 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:24.417689 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d0a40bec-b4d3-4296-a896-e7574e5b24e9 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.245580 Aug 24 05:46:24.435614 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 36/76] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:24 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:24.461876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:24.463179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:24.471678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.473365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.474664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.476052 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.476881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.477480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.641269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:24.642179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:24.648485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.653936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.654915 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.655814 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.659968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.660748 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.737853 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:24.752661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5dedd40d-0f93-40b2-a5ea-4a1c11109e08 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.296047 Aug 24 05:46:24.753290 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 41/77] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:24 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:24.807040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:24.807655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:24.815610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.816089 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.816512 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.817383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:24.818020 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:24.818580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:24.961544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:24.974316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:24.976421 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:24.978801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3381890e-cbab-4ea1-ade1-644b05654fde tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.341968 Aug 24 05:46:24.979825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 37/78] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:24 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:25.133594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:25.143980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dc1aa44a-7be6-4b86-9c6d-12eb6394804d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.345408 Aug 24 05:46:25.158884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 42/79] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:24 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:25.446475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:25.447858 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:25.461186 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:25.461951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:25.462525 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:25.463393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:25.464018 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:25.466164 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:25.752196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:25.762882 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ff10170a-0e2a-4865-9a15-6204a2ba3e60 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.320833 Aug 24 05:46:25.767693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 38/80] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:25 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:25.787854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:25.789177 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:25.806418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:25.807550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:25.814018 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:25.815572 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:25.816278 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:25.816749 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.006919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:26.007763 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:26.027740 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.031132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.031769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.034874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.035576 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.037299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.042551 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:26.058306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c63c05bd-0b4f-4f20-b227-674d15c7091a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.274950 Aug 24 05:46:26.062284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 43/81] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:25 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:26.167082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:26.168580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:26.182817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.183326 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.183775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.189198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.189719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.190163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.326561 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:26.352521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:26.360685 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:26.363396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4e740c78-c920-4755-9bef-19e1d6b7a633 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.360168 Aug 24 05:46:26.363982 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 39/82] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:25 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:26.556890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:26.572347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9d4ca04c-2219-478d-be06-04ddce803ed3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.409671 Aug 24 05:46:26.573316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 44/83] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:26 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:26.789250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:26.790104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:26.798504 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.801623 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.802175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:26.804584 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:26.806400 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:26.812161 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.032641 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:27.045255 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-699e66ca-ab29-48df-a292-f56a48aba0e3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.261284 Aug 24 05:46:27.046272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 40/84] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:26 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:27.083113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:27.084583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:27.093429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.093965 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.094612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.095677 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.096335 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.096965 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.287071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:27.315490 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bcb62d14-8d57-4812-9f48-1115f230af57 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.238385 Aug 24 05:46:27.317743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 45/85] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:27 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:27.387619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:27.388807 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:27.410745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.411235 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.411681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.412396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.412840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.413265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.592923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:27.593922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:27.602997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.603903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.606864 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.607860 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:27.608759 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:27.611898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:27.618021 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:27.628633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:27.633750 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:27.646930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-44812374-4291-4e27-8006-53cae9e5ac2e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.253364 Aug 24 05:46:27.649478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 41/86] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:27 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:27.871699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:27.881138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2ee0bc5f-059d-4eea-8801-77af35fc2911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.292442 Aug 24 05:46:27.887195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 46/87] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:27 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:28.069261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:28.069925 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:28.077514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.078012 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.078521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.079940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.080398 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.080821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.243101 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:28.250943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a0a289c0-419a-4182-b973-b2b552fe542b tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.187473 Aug 24 05:46:28.262558 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 42/88] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:28 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:28.340058 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:28.340674 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:28.346861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.347561 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.357440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.358592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.362150 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.362600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.510067 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:28.518427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-38ee4158-f030-4e7f-8792-2e51377b87a7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.182112 Aug 24 05:46:28.519033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 47/89] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:28 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:28.674506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:28.675634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:28.684878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.686416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.687320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.688751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.689652 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.690702 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.898492 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:28.909504 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:28.910149 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:28.929757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:28.931447 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:28.932329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.933147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.933593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:28.937360 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-eb922d5d-1325-4f15-ba18-0d6881cfbf9b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.268105 Aug 24 05:46:28.939438 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:28.942255 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:28.942871 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 43/90] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:28 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:28.943395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.277405 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:29.278636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:29.291014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.291840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.293509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.298247 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.298884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.299505 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.498661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:29.510223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ef3418e1-b6a5-49fa-ba25-180a1d7b3c3e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.605161 Aug 24 05:46:29.523720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 48/91] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:28 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:29.543902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:29.544560 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:29.577294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.577926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.579787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:29.580544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:29.582446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:29.588276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.378788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.392064 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8433d813-9337-4ec7-bf60-b0a08cf5c5e9 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.856461 Aug 24 05:46:30.392665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 49/92] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:29 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:30.397261 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:30.406809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:30.432983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.433472 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.433938 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.434645 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.435651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.436080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.464270 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.473057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:30.484053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2f7b3c21-b59a-4aa1-b943-b08438a726ba tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 1.210502 Aug 24 05:46:30.488517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 44/93] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:29 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:30.538851 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:30.540067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:30.561091 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.561385 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.561928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.562660 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:30.563228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:30.569195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:30.942627 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.969687 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.974314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:30.983458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-be3cb912-bd97-4700-beda-428f80a360e4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.587940 Aug 24 05:46:30.985536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 50/94] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:30 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:31.006543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:31.021108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-41dbaa58-71f8-4da5-b1ff-1beec0a7209f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.488854 Aug 24 05:46:31.024641 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 45/95] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:30 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:31.414719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:31.415634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:31.427572 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.430116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.433086 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.435662 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.438822 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.439427 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.604172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-74c009d4-9235-4a04-8582-b215c86e73be req-1fddc5ec-7dab-4c7f-8459-73f41bea8a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d5dce2-87d9-41e2-87bd-e25ffdab7014", "tag": "837c49ba-3839-4640-af5d-797916aa3934"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:31.645001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-74c009d4-9235-4a04-8582-b215c86e73be req-1fddc5ec-7dab-4c7f-8459-73f41bea8a1a service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.647945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-74c009d4-9235-4a04-8582-b215c86e73be req-1fddc5ec-7dab-4c7f-8459-73f41bea8a1a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.648503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-74c009d4-9235-4a04-8582-b215c86e73be req-1fddc5ec-7dab-4c7f-8459-73f41bea8a1a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.705257 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-74c009d4-9235-4a04-8582-b215c86e73be req-1fddc5ec-7dab-4c7f-8459-73f41bea8a1a service nova] Creating event network-changed:837c49ba-3839-4640-af5d-797916aa3934 for instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 on hv-cinder-85426 Aug 24 05:46:31.707124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-74c009d4-9235-4a04-8582-b215c86e73be req-1fddc5ec-7dab-4c7f-8459-73f41bea8a1a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127194) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 05:46:31.709376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-74c009d4-9235-4a04-8582-b215c86e73be req-1fddc5ec-7dab-4c7f-8459-73f41bea8a1a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127194) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 05:46:31.722720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.722720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.722720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.722720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.722720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.723157 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.760484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.compute.rpcapi [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 05:46:31.761899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] Releasing lock "compute-rpcapi-router" {{(pid=127194) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 05:46:31.805415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e98bcaa0-26dc-431b-8bc8-0f3241160107 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.572186 Aug 24 05:46:31.807184 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 51/96] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:31.818888 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:31.819675 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:31.833139 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.834622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.836836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:31.838548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:31.848870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:31.849458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.103146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.117345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f81513ad-925a-4dcf-b908-bf696288270c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.708938 Aug 24 05:46:32.130851 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 46/97] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:31 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:32.214475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.229907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-813c7c8f-123a-448e-bb66-1af611b8679a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.420203 Aug 24 05:46:32.230519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 52/98] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:31 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:32.238614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:32.239540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:32.251836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.253351 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.254056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.255792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.256518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.257213 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.395339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-49b8a02e-f14d-4158-bfcf-321683045970 req-eb2dd07e-983b-4337-aeff-584450bc2b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0914a19f-ad14-4b39-84b5-dc7296adcf95", "tag": "0e532727-0ead-446a-aabc-351f29073b6f"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:32.408428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49b8a02e-f14d-4158-bfcf-321683045970 req-eb2dd07e-983b-4337-aeff-584450bc2b06 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.408905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49b8a02e-f14d-4158-bfcf-321683045970 req-eb2dd07e-983b-4337-aeff-584450bc2b06 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.409336 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49b8a02e-f14d-4158-bfcf-321683045970 req-eb2dd07e-983b-4337-aeff-584450bc2b06 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.431155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-49b8a02e-f14d-4158-bfcf-321683045970 req-eb2dd07e-983b-4337-aeff-584450bc2b06 service nova] Creating event network-changed:0e532727-0ead-446a-aabc-351f29073b6f for instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 on hv-cinder-85426 Aug 24 05:46:32.431698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49b8a02e-f14d-4158-bfcf-321683045970 req-eb2dd07e-983b-4337-aeff-584450bc2b06 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127193) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 05:46:32.432089 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49b8a02e-f14d-4158-bfcf-321683045970 req-eb2dd07e-983b-4337-aeff-584450bc2b06 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127193) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 05:46:32.433134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.433624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.434485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.435434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.435889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.436306 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.437110 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.447981 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.448407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.compute.rpcapi [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 05:46:32.449530 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] Releasing lock "compute-rpcapi-router" {{(pid=127193) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 05:46:32.449661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.451221 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-22095c7c-ac83-430e-a31e-4d5f26719152 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.217403 Aug 24 05:46:32.451815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 53/99] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:32 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:32.461035 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:32.461673 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:32.473159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.473698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.474112 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.474920 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:32.475430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:32.476124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:32.479963 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-39229bb6-2f69-4a18-b98a-85ce6f063c7e None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353991 Aug 24 05:46:32.481208 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 47/100] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:32.684178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:32.693967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-770c0ecf-f213-4683-99e8-0cc3d95e8a13 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.240902 Aug 24 05:46:32.695048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 54/101] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:32 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:33.139986 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:33.142074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:33.149050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.149949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.150592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.151653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.152416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.153388 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.178472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:33.253856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:33.255249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:33.277758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.277758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.277758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.277758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.278031 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.278475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.312410 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.320496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-483747a2-9539-425f-b9a1-4b31ff6d1c12 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.185686 Aug 24 05:46:33.321371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 48/102] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:33 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:33.444439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.452879 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-81f043cb-1cfa-4d8a-98bc-a7985546bcb3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.205170 Aug 24 05:46:33.453537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 55/103] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:33 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:33.473491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:33.474284 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:33.480412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.480894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.481330 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.482753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.483099 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.483814 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.629503 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.640607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.643126 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:33.644572 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ebbb0236-d1d6-4edc-abb3-9f9999c5dc1b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.174930 Aug 24 05:46:33.645408 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 49/104] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:33 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:33.716514 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:33.717127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:33.732966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.733759 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.734367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.735216 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:33.735673 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:33.736275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:33.998893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-5d148019-81df-4495-9740-0ed76abd501b req-0dc1e96e-6610-4189-a8df-2e24ac3afddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698069e6-1a88-41db-9ac7-3a8a9dad417b", "tag": "3c60e261-b383-47d1-b112-4e9820cc8fbd"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:34.017451 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-5d148019-81df-4495-9740-0ed76abd501b req-0dc1e96e-6610-4189-a8df-2e24ac3afddb service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.017952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-5d148019-81df-4495-9740-0ed76abd501b req-0dc1e96e-6610-4189-a8df-2e24ac3afddb service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.018375 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-5d148019-81df-4495-9740-0ed76abd501b req-0dc1e96e-6610-4189-a8df-2e24ac3afddb service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.031224 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-5d148019-81df-4495-9740-0ed76abd501b req-0dc1e96e-6610-4189-a8df-2e24ac3afddb service nova] Creating event network-changed:3c60e261-b383-47d1-b112-4e9820cc8fbd for instance 698069e6-1a88-41db-9ac7-3a8a9dad417b on hv-cinder-85426 Aug 24 05:46:34.036098 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-5d148019-81df-4495-9740-0ed76abd501b req-0dc1e96e-6610-4189-a8df-2e24ac3afddb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043232 Aug 24 05:46:34.036694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 50/105] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:34.135066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.147680 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-94d4419b-0e51-45c2-be55-8a53505b5e2f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.435719 Aug 24 05:46:34.148460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 56/106] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:33 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:34.342209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:34.343162 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:34.349502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.350012 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.350457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.351533 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.352142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.352563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.477452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:34.478074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:34.490222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.490983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.491531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.492554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.493478 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.494122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.689712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.704555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8c14e1a4-4152-4e53-9d80-cc1144032652 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.366586 Aug 24 05:46:34.705138 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 51/107] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:34 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:34.717370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:34.719506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:34.725619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.726311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.726748 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.727468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.728124 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.728701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.802707 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.816840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-eaa10026-52c7-474c-abc1-592b37d91265 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.345104 Aug 24 05:46:34.818503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 57/108] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:34 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:34.823495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-8640a9d1-e0d2-4671-b0c8-23a964977ee6 req-fe15b51a-9688-44bb-836d-58a9dd7511f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e7b469-f365-451f-95bc-812608b89ecc", "tag": "b4d50320-e71a-4b22-9b7d-c494b0c340ce"}, {"name": "network-changed", "server_uuid": "e5fa2638-f92b-43b2-b0a8-000e3ab5ad80", "tag": "70fc4815-0bd1-4410-9f20-00e50e3a8dee"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:34.836669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-8640a9d1-e0d2-4671-b0c8-23a964977ee6 req-fe15b51a-9688-44bb-836d-58a9dd7511f7 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:34.838441 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-8640a9d1-e0d2-4671-b0c8-23a964977ee6 req-fe15b51a-9688-44bb-836d-58a9dd7511f7 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:34.838930 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-8640a9d1-e0d2-4671-b0c8-23a964977ee6 req-fe15b51a-9688-44bb-836d-58a9dd7511f7 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:34.857268 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-8640a9d1-e0d2-4671-b0c8-23a964977ee6 req-fe15b51a-9688-44bb-836d-58a9dd7511f7 service nova] Creating event network-changed:b4d50320-e71a-4b22-9b7d-c494b0c340ce for instance 01e7b469-f365-451f-95bc-812608b89ecc on hv-cinder-85426 Aug 24 05:46:34.857814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-8640a9d1-e0d2-4671-b0c8-23a964977ee6 req-fe15b51a-9688-44bb-836d-58a9dd7511f7 service nova] Creating event network-changed:70fc4815-0bd1-4410-9f20-00e50e3a8dee for instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 on hv-cinder-85426 Aug 24 05:46:34.865008 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-8640a9d1-e0d2-4671-b0c8-23a964977ee6 req-fe15b51a-9688-44bb-836d-58a9dd7511f7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044701 Aug 24 05:46:34.865483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 58/109] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:34.969678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.988986 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.992317 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:34.994354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-87163b35-a0e9-445a-bf89-e183e165821c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.283511 Aug 24 05:46:34.995684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 52/110] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:34 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:35.169036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:35.169820 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:35.176069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.176546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.176971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.177912 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.178481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.179241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.379189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:35.402305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3d924d30-67bc-4fa0-867e-d8cdc7b537e9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.223890 Aug 24 05:46:35.405203 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 59/111] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:35 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:35.726541 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:35.728347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:35.735783 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.736678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.737282 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.738204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.738844 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.739657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.843787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:35.844854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:35.851158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.852071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.852775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.853792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:35.854535 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:35.855225 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:35.909044 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:35.921347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-faaddc5d-bd11-438a-8d00-2f4639e13d93 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.195917 Aug 24 05:46:35.922331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 53/112] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:35 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:36.018843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:36.019660 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:36.030448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.033185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.033847 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.035374 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.035836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.039509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.130338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.139710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0e79373b-d4fa-4434-bc5f-3ddf20fdd3d4 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.301115 Aug 24 05:46:36.140593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 60/113] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:35 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:36.261625 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.271175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.272687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.274027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-55e76495-587e-4e29-80ad-cf4620dd0064 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.260749 Aug 24 05:46:36.274543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 54/114] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:36 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:36.429612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:36.430338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:36.436803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.437193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.437657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.438352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.438801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.439318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.590303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:36.610627 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7c411c41-9dad-4894-961a-5157aade2365 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.184916 Aug 24 05:46:36.612185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 61/115] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:36 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:36.941858 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:36.942474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:36.948564 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.949040 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.949713 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:36.950478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:36.951116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:36.951681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.102269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.112054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-cce1189f-b082-49f8-b723-32f646005509 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.174002 Aug 24 05:46:37.112792 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 55/116] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:36 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:37.160573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:37.161304 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:37.167540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.168013 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.168434 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.169755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.170206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.170803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.297551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:37.298332 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:37.308857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.309903 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.311004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.311998 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.312495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.314339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.316843 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.329353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f362141d-fc05-4ca0-96cd-9b3b88f4d245 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.172571 Aug 24 05:46:37.343847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 62/117] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:37 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:37.467727 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.477400 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.479074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.480193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ef9341d5-ed64-48c5-a396-f3745fa21486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.187397 Aug 24 05:46:37.481060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 56/118] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:37 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:37.644199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:37.644808 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:37.652953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.653485 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.654202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.654905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:37.655607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:37.656029 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:37.822514 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:37.830101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-612992c6-ff97-41cb-b572-1f000b57e328 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.199347 Aug 24 05:46:37.830684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 63/119] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:37 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:38.134285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:38.134898 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:38.142080 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.142494 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.142914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.143602 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.144043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.144507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.282405 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:38.291003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-10dd0fcc-acf5-49a9-9d9c-763febc9ee39 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.160762 Aug 24 05:46:38.291584 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 57/120] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:38 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:38.350874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:38.351477 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:38.357429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.357935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.358611 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.359299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.359769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.360189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.506915 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:38.508625 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:38.518456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.519224 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.519785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.520799 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.521583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.522417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.566768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:38.574700 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-34050945-c132-4364-8fe1-68fbd3f05452 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.227520 Aug 24 05:46:38.579429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 64/121] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:38 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:38.853868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:38.855927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:38.865531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.866525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.867397 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.875387 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:38.885876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:38.886521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:38.887063 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:38.892005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:38.893592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:38.894896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6ab84443-22d8-4968-a9e4-c72fe982e4fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.395070 Aug 24 05:46:38.897646 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 58/122] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:38 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:46:39.035303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:39.043284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0fd8ce5f-084e-4fff-8f70-e32d65ca3cb9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.196048 Aug 24 05:46:39.043813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 65/123] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:38 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:39.316233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:39.317513 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:39.325744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.327372 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.327929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.329120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.329744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.330311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.600785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:39.602158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:39.609378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.610091 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.610874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.611908 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.613002 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.613648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.744258 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:39.767565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-87819a8a-05bd-44af-9f1c-0479f79e9228 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.450449 Aug 24 05:46:39.768249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 59/124] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:39 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:39.869208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:39.879947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d25a45b9-1fda-43c7-b243-5ea3bbe26253 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.283195 Aug 24 05:46:39.880973 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 66/125] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:39 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:39.929592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:39.930413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:39.937732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.938307 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.938939 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:39.939725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:39.940275 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:39.940846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.065591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:40.066418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:40.072609 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.073295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.074035 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.074929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.075679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.076333 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.117765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.128445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.130704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.132404 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d36246d5-9970-4c27-a897-4000d2adb380 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.209550 Aug 24 05:46:40.133465 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 60/126] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:39 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:40.262416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:40.270970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-65120d84-d5d6-4866-9d27-44b1121acb62 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.209565 Aug 24 05:46:40.271549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 67/127] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:40 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:40.791587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:40.792726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:40.816400 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.817186 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.818642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.823128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.823819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.824618 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.903078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:40.905440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:40.917117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.918815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.920998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.922010 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:40.925582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:40.926282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:40.942473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:41.270923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.281791 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-31cbe5cd-6a1e-4499-b81a-4d7d7a3e32c3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.496250 Aug 24 05:46:41.282370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 61/128] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:40 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:41.288667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:41.289469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:41.296302 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.296786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.297218 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.297960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.298573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.299386 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.317256 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.326020 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-241a8303-9254-4666-9e10-168b30061477 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.427968 Aug 24 05:46:41.326835 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 68/129] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:40 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:41.403166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-869a74fa-026b-4fad-9aa6-45ad1188b395 req-b3ff9e57-a491-4d5f-9f6c-ef566ba7b5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d5dce2-87d9-41e2-87bd-e25ffdab7014", "name": "network-vif-plugged", "status": "completed", "tag": "837c49ba-3839-4640-af5d-797916aa3934"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:41.417649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-869a74fa-026b-4fad-9aa6-45ad1188b395 req-b3ff9e57-a491-4d5f-9f6c-ef566ba7b5ad service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.418396 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-869a74fa-026b-4fad-9aa6-45ad1188b395 req-b3ff9e57-a491-4d5f-9f6c-ef566ba7b5ad service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.419130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-869a74fa-026b-4fad-9aa6-45ad1188b395 req-b3ff9e57-a491-4d5f-9f6c-ef566ba7b5ad service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.434498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-869a74fa-026b-4fad-9aa6-45ad1188b395 req-b3ff9e57-a491-4d5f-9f6c-ef566ba7b5ad service nova] Creating event network-vif-plugged:837c49ba-3839-4640-af5d-797916aa3934 for instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 on hv-cinder-85426 Aug 24 05:46:41.456880 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-869a74fa-026b-4fad-9aa6-45ad1188b395 req-b3ff9e57-a491-4d5f-9f6c-ef566ba7b5ad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128295 Aug 24 05:46:41.458275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 69/130] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:41.465690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:41.467096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:41.475024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.475831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.476452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.477332 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:41.478509 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:41.479087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:41.571987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.581180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.583373 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.584580 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1aa1a9d6-d69b-470f-b4a7-6488e3bdb514 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.301126 Aug 24 05:46:41.585263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 62/131] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:41 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:41.759691 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:41.788681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:41.797701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-10ced21f-71c9-4677-aa90-ccbfdb7749f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.337621 Aug 24 05:46:41.798499 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 70/132] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:41 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:42.317008 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:42.318949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:42.326982 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.327803 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.328523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.329584 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.330312 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.331114 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.352209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:42.352929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:42.370818 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.378371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.378829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.379682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.380134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.384713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.445499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:42.798511 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:42.817003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-45e3d9f7-42fe-40ec-82db-f07436aecebf tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.473346 Aug 24 05:46:42.820860 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 71/133] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:42 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:42.832668 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:42.834756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:42.851714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.852263 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.852697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:42.856040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:42.856592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:42.858967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.090540 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:43.100032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7ab390c3-bb25-4dd6-812d-9616587440cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.801135 Aug 24 05:46:43.103058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 63/134] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:42 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:43.120446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:43.121527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:43.131265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.131987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.134311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.137862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.137862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.137862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.165793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:43.181124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:43.187067 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:43.188741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ce3f8df3-950e-4599-829b-47e3f222be33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.366311 Aug 24 05:46:43.189953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 72/135] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:42 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:43.770713 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:43.797097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-51afd041-9c3f-4f3f-81ec-a916948d7c3c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.689207 Aug 24 05:46:43.799752 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 64/136] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:43 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:43.841379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:43.841898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:43.850462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.852055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.853302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:43.854379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:43.856964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:43.857411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.124834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:44.125710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:44.137313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.137909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.138356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.139079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.139527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.139955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.235838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.248702 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0999f35b-d53c-44d3-a027-f1416e2f814d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.408970 Aug 24 05:46:44.261934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 73/137] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:43 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:44.275092 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:44.275933 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:44.284161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.284881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.285537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.286470 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.287120 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.287763 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.471118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.481664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.484246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.485726 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-73c4a2e9-d864-4c7d-8a8b-57546b94c8c9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.226398 Aug 24 05:46:44.486769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 74/138] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:44 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:44.518434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:44.521908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:44.533323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f6ad0a40-5ddd-44f9-924a-a4daabc61ca8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.412933 Aug 24 05:46:44.533745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 65/139] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:44 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:44.823700 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:44.824766 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:44.834124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.835250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.837105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:44.838250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:44.839004 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:44.839620 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.202944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.224910 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b48a29ee-ab6f-41b3-9b5b-98af641a053f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.408320 Aug 24 05:46:45.237962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 75/140] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:44 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:45.274968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:45.276412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:45.286393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.287152 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.287987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.289075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.290304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.291013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.500971 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.509557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:45.510519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:45.512148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8b80abc5-c05b-434c-b6c1-a30b62e365ab tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.241634 Aug 24 05:46:45.513598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 66/141] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:45 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:45.522606 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.523182 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.523698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.525415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.526181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.527870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.558804 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:45.563407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:45.579801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.582521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.583176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.586103 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:45.587169 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:45.589168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:45.864523 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.873221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.876527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.878519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:45.879841 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dd723d5b-f5fa-4e49-a24e-41f4134adfd7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1406 microversion: 2.20 time: 0.375373 Aug 24 05:46:45.887057 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-51175815-646b-4687-9004-2b5fee03f03a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.334836 Aug 24 05:46:45.896180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 76/142] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:45 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:45.901456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 67/143] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:45 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:46.085249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-faec33a8-8f63-4e34-80ab-d887042da616 req-39ffcf35-0b6e-404a-a19c-0c7e3367d35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0914a19f-ad14-4b39-84b5-dc7296adcf95", "name": "network-vif-plugged", "status": "completed", "tag": "0e532727-0ead-446a-aabc-351f29073b6f"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:46.121392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-faec33a8-8f63-4e34-80ab-d887042da616 req-39ffcf35-0b6e-404a-a19c-0c7e3367d35b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.126895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-faec33a8-8f63-4e34-80ab-d887042da616 req-39ffcf35-0b6e-404a-a19c-0c7e3367d35b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.130837 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-faec33a8-8f63-4e34-80ab-d887042da616 req-39ffcf35-0b6e-404a-a19c-0c7e3367d35b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.183118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-faec33a8-8f63-4e34-80ab-d887042da616 req-39ffcf35-0b6e-404a-a19c-0c7e3367d35b service nova] Creating event network-vif-plugged:0e532727-0ead-446a-aabc-351f29073b6f for instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 on hv-cinder-85426 Aug 24 05:46:46.205768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-faec33a8-8f63-4e34-80ab-d887042da616 req-39ffcf35-0b6e-404a-a19c-0c7e3367d35b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124724 Aug 24 05:46:46.209453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 77/144] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:46.248893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:46.249638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:46.264221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.266466 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.268574 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.271036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.273192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.274170 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.538223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:46.539364 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:46.548327 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.549258 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.549867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.551906 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.552621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.554351 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.751206 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:46.764271 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-39460677-c781-4044-a251-2cadd66622e1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.519459 Aug 24 05:46:46.777860 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 68/145] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:46 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:46.907684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:46.908304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:46.921149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.923241 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.923766 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.924499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:46.926886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:46.927429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:46.995616 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.010602 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d3083fc1-de9c-4db0-bb01-3dd06bd5d42d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.477647 Aug 24 05:46:47.027248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 78/146] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:46 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:47.034019 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:47.034840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:47.043445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.045019 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.045634 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.046723 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.047383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.048337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.250913 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.268247 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.270668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.271923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9192aa68-a4c1-412d-9a65-b4426fcef554 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1598 microversion: 2.20 time: 0.371644 Aug 24 05:46:47.272422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 69/147] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:46:46 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1598 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:46:47.301982 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:47.302496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:47.309018 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.310061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.310491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.311893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.312542 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.313141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.413516 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:47.423200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6c7c975c-886a-463f-8c61-b7c9294de550 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1367 microversion: 2.1 time: 0.394651 Aug 24 05:46:47.438427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 79/148] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:47 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1367 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:47.476887 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-76a51bec-b9f9-4015-8a99-8831a456bfaf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.179068 Aug 24 05:46:47.477714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 70/149] 10.222.0.73 () {60 vars in 1316 bytes} [Wed Aug 24 05:46:47 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:46:47.800934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:47.801781 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:47.810275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.811188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.811772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:47.813117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:47.813748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:47.814339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.013868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:48.023262 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-521c4afe-fb69-4090-b104-f8e7fc1d05f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.236975 Aug 24 05:46:48.023840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 80/150] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:47 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:48.032799 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:48.034094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:48.041824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.043254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.044862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.045477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.047347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.047776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.229066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-a9bf3a80-0aaa-48d7-91b5-be2ff9e0efc7 req-a09131ba-d310-45dc-a9cc-b8610cd29d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698069e6-1a88-41db-9ac7-3a8a9dad417b", "name": "network-vif-plugged", "status": "completed", "tag": "3c60e261-b383-47d1-b112-4e9820cc8fbd"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:48.266017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-a9bf3a80-0aaa-48d7-91b5-be2ff9e0efc7 req-a09131ba-d310-45dc-a9cc-b8610cd29d52 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.266448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-a9bf3a80-0aaa-48d7-91b5-be2ff9e0efc7 req-a09131ba-d310-45dc-a9cc-b8610cd29d52 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.266875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-a9bf3a80-0aaa-48d7-91b5-be2ff9e0efc7 req-a09131ba-d310-45dc-a9cc-b8610cd29d52 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.308314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-a9bf3a80-0aaa-48d7-91b5-be2ff9e0efc7 req-a09131ba-d310-45dc-a9cc-b8610cd29d52 service nova] Creating event network-vif-plugged:3c60e261-b383-47d1-b112-4e9820cc8fbd for instance 698069e6-1a88-41db-9ac7-3a8a9dad417b on hv-cinder-85426 Aug 24 05:46:48.329321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-a9bf3a80-0aaa-48d7-91b5-be2ff9e0efc7 req-a09131ba-d310-45dc-a9cc-b8610cd29d52 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103708 Aug 24 05:46:48.332653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 81/151] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:48.450857 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:48.451563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:48.460095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.460752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.461804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.470565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.471391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.472128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.817938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:48.830242 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-90e57f29-309b-4675-8c30-9b7fa19f9fa7 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.801749 Aug 24 05:46:48.831141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 71/152] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:48 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:48.876509 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:48.916171 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b007c187-10b4-416e-82c4-a6a5bdf33600 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1557 microversion: 2.1 time: 0.469648 Aug 24 05:46:48.920875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 82/153] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:48 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1557 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:48.945069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:48.945922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:48.955656 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.956604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.957715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:48.958763 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:48.959376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:48.960776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.048879 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:49.061084 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:49.086413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.087255 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.087975 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.089167 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.092083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.096443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.115024 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a86951f3-81cf-469f-8010-db6f67d305ff tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173024 Aug 24 05:46:49.119842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 72/154] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:46:48 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:49.448969 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1260959958", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "networks": [{"uuid": "558b67e1-5aa8-4b40-be83-48a482e5c09e"}]}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:49.579709 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] validate_networks() for [('558b67e1-5aa8-4b40-be83-48a482e5c09e', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:46:49.772137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:49.780498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6d4ee533-1043-4bf7-bb45-9869c6f60195 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.738694 Aug 24 05:46:49.793410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 83/155] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:49 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:49.851082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:49.851752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:49.863394 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.863886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.864312 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:49.865021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:49.865465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:49.880506 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.167291 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:50.195276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-594979cc-3a4c-48d0-bd70-09b542a0dcc5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.348396 Aug 24 05:46:50.195866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 84/156] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:49 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:50.352480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-dd56a3d8-db96-42b2-a460-4fb1372548e5 req-31355de1-d88b-4522-9e63-36159d9b6ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fa2638-f92b-43b2-b0a8-000e3ab5ad80", "name": "network-vif-plugged", "status": "completed", "tag": "70fc4815-0bd1-4410-9f20-00e50e3a8dee"}, {"server_uuid": "01e7b469-f365-451f-95bc-812608b89ecc", "name": "network-vif-plugged", "status": "completed", "tag": "b4d50320-e71a-4b22-9b7d-c494b0c340ce"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:50.365310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:50.383158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-dd56a3d8-db96-42b2-a460-4fb1372548e5 req-31355de1-d88b-4522-9e63-36159d9b6ca3 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.384442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-dd56a3d8-db96-42b2-a460-4fb1372548e5 req-31355de1-d88b-4522-9e63-36159d9b6ca3 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.384950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-dd56a3d8-db96-42b2-a460-4fb1372548e5 req-31355de1-d88b-4522-9e63-36159d9b6ca3 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.426491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-dd56a3d8-db96-42b2-a460-4fb1372548e5 req-31355de1-d88b-4522-9e63-36159d9b6ca3 service nova] Creating event network-vif-plugged:70fc4815-0bd1-4410-9f20-00e50e3a8dee for instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 on hv-cinder-85426 Aug 24 05:46:50.430846 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-dd56a3d8-db96-42b2-a460-4fb1372548e5 req-31355de1-d88b-4522-9e63-36159d9b6ca3 service nova] Creating event network-vif-plugged:b4d50320-e71a-4b22-9b7d-c494b0c340ce for instance 01e7b469-f365-451f-95bc-812608b89ecc on hv-cinder-85426 Aug 24 05:46:50.450199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-dd56a3d8-db96-42b2-a460-4fb1372548e5 req-31355de1-d88b-4522-9e63-36159d9b6ca3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100966 Aug 24 05:46:50.451492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 85/157] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:50.534066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-739214c1-1696-4f5b-ae48-2829d9676f2f req-ff370aeb-cdbd-45be-b625-eeeb5461808d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d5dce2-87d9-41e2-87bd-e25ffdab7014", "tag": "837c49ba-3839-4640-af5d-797916aa3934"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:50.555520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-739214c1-1696-4f5b-ae48-2829d9676f2f req-ff370aeb-cdbd-45be-b625-eeeb5461808d service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.556299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-739214c1-1696-4f5b-ae48-2829d9676f2f req-ff370aeb-cdbd-45be-b625-eeeb5461808d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.556883 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-739214c1-1696-4f5b-ae48-2829d9676f2f req-ff370aeb-cdbd-45be-b625-eeeb5461808d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.592370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-739214c1-1696-4f5b-ae48-2829d9676f2f req-ff370aeb-cdbd-45be-b625-eeeb5461808d service nova] Creating event network-changed:837c49ba-3839-4640-af5d-797916aa3934 for instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 on hv-cinder-85426 Aug 24 05:46:50.605315 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-739214c1-1696-4f5b-ae48-2829d9676f2f req-ff370aeb-cdbd-45be-b625-eeeb5461808d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077050 Aug 24 05:46:50.608108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 86/158] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:50.725046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:46:50.725959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:46:50.726541 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:46:50.729186 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:46:50.730279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:46:50.747673 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.748628 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.749659 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.750719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.752092 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.752978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.807706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:50.808462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:50.823907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.824401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.824838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.827770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:50.829296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:50.830504 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:50.845732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Getting quotas for project 82f6c80e9245427aad8acd3c8bd5efbc. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:46:50.867765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Getting quotas for user a621860d8fcb4327820ce6b802e6a725 and project 82f6c80e9245427aad8acd3c8bd5efbc. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:46:50.917881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:46:50.927145 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:46:51.025924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5707eb12-82d2-4181-aae5-9f4179271027 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582959 Aug 24 05:46:51.027102 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 73/159] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:46:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:46:51.037754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-01a56b16-4d60-42b9-ad95-b0fc25788dee tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:51.038498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-01a56b16-4d60-42b9-ad95-b0fc25788dee tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:51.244123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-01a56b16-4d60-42b9-ad95-b0fc25788dee tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:51.252840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-01a56b16-4d60-42b9-ad95-b0fc25788dee tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1214 microversion: 2.1 time: 0.218975 Aug 24 05:46:51.254098 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 74/160] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:51 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:51.258860 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:51.259667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:51.266301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.270017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.270680 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.271403 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.272273 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.273637 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.274227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.541603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:51.554421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2b95c0fd-d83d-4068-b729-811c00f4fba2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.750209 Aug 24 05:46:51.556401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 87/161] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:50 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:51.624468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:51.641151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-25cffd73-0189-430f-a74d-fc0f1eec4d64 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.385688 Aug 24 05:46:51.642539 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 75/162] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:51 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:51.891561 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-dc799f25-01a3-4d92-a86e-5c3b8f8b70af req-774e04a3-00ad-4e86-b259-6a9e9aec1e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0914a19f-ad14-4b39-84b5-dc7296adcf95", "tag": "0e532727-0ead-446a-aabc-351f29073b6f"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:51.912782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-dc799f25-01a3-4d92-a86e-5c3b8f8b70af req-774e04a3-00ad-4e86-b259-6a9e9aec1e13 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:51.913707 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-dc799f25-01a3-4d92-a86e-5c3b8f8b70af req-774e04a3-00ad-4e86-b259-6a9e9aec1e13 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:51.914313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-dc799f25-01a3-4d92-a86e-5c3b8f8b70af req-774e04a3-00ad-4e86-b259-6a9e9aec1e13 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:51.919676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:51.943915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-dc799f25-01a3-4d92-a86e-5c3b8f8b70af req-774e04a3-00ad-4e86-b259-6a9e9aec1e13 service nova] Creating event network-changed:0e532727-0ead-446a-aabc-351f29073b6f for instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 on hv-cinder-85426 Aug 24 05:46:51.954801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-dc799f25-01a3-4d92-a86e-5c3b8f8b70af req-774e04a3-00ad-4e86-b259-6a9e9aec1e13 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072413 Aug 24 05:46:51.955850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 88/163] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:52.278998 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:52.279690 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:52.286217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.286978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.287800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.289068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.289687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.290313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.377807 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.387380 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9d5c1c5d-2338-4ce9-98e0-c3c7d44cce60 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1218 microversion: 2.1 time: 0.113663 Aug 24 05:46:52.402022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 76/164] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:52 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:52.580891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:52.581751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:52.588231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.588788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.589418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.590163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.590950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.591390 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.663143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:52.663775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:52.672712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.673262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.673841 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.674497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:52.674966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:52.675389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:52.751217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.759316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8f3db3c6-60de-4a14-a42d-838a124b2e7e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1321 microversion: 2.1 time: 0.184143 Aug 24 05:46:52.759910 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 89/165] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:52 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:52.819116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:52.827302 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5d5b6e1b-d78b-4240-bc49-692e11542a8d tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.168243 Aug 24 05:46:52.827888 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 77/166] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:52 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:53.409447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:53.411964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:53.421754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.422513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.423966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.425016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.426410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.427076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.532710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:53.541972 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c80c693f-edfb-4140-b217-f221f4f24e07 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1266 microversion: 2.1 time: 0.137457 Aug 24 05:46:53.543183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 90/167] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:53 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:53.782707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:53.782707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:53.788418 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.789491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.790152 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.791187 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.791694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.792267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.849186 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:53.850265 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:53.862698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.863909 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.865581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:53.866631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:53.869066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:53.873245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.009623 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.029839 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-dc78392d-f018-432d-8f16-c9ba1e0c543b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1515 microversion: 2.1 time: 0.253177 Aug 24 05:46:54.034415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 78/168] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:53 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:54.051657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.058430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:54.061630 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:54.068528 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.069272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.070028 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.070941 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.071575 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.072321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.078234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-05cebddb-4823-478d-b474-90be2ec6dc54 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1314 microversion: 2.1 time: 0.217880 Aug 24 05:46:54.093127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 91/169] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:53 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:54.129480 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lazy-loading 'flavor' on Instance uuid e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:46:54.306828 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d1957b8f-3305-4173-bbc4-6e0938c0d5a5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80/action" status: 200 len: 32 microversion: 2.1 time: 0.254525 Aug 24 05:46:54.307882 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 79/170] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:46:54 2022] POST /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:46:54.316979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:54.318183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:54.331200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.331854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.332352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.333114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.333812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.334409 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.548505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.557421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-585b454b-00b9-4baf-a451-4edecf08d8e2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.244282 Aug 24 05:46:54.559415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 92/171] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:54 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:54.565108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:54.566029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:54.572149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.572645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.573067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.573808 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:54.574263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:54.574683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:54.675428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:54.684578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-16f14475-5f88-4dcb-9b9c-3197faf8990e tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1266 microversion: 2.1 time: 0.123600 Aug 24 05:46:54.685319 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 80/172] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:54 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:55.100188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:55.101073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:55.107801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.108699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.109208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.110034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.111143 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.111571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.347947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:55.356345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-48cddf5d-2de7-49b3-ac5a-8ebaf60d0ea5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1501 microversion: 2.1 time: 0.259949 Aug 24 05:46:55.384947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 93/173] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:55 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1501 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:55.580937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:55.581720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:55.593597 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.594254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.595417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.598168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.599753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.601899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.707932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:55.709181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:55.717095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.717815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.718387 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.719327 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:55.719922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:55.721215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:55.808223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:55.820748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cdbc9018-91ad-4a98-9351-ce3e655ff41a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1272 microversion: 2.1 time: 0.118908 Aug 24 05:46:55.825191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 94/174] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:55 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:56.452776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:56.470058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ff08fdba-62ca-4697-a005-89bdc05f8c73 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.891188 Aug 24 05:46:56.471505 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 81/175] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:55 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:56.846758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:56.847387 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:56.854280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:56.857587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:56.858076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:56.861995 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:56.863081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:56.864317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:56.985840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65ca0596-ad91-4545-a63a-ba9eb056a962"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:56.989908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:56.999637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:57.009037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fc4e14a1-6fca-4ed8-9af7-79073181a2fa tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1272 microversion: 2.1 time: 0.166847 Aug 24 05:46:57.014800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.015718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 95/176] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:56 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:57.016439 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.017083 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.018435 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.019096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.019742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.145468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:57.493810 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:57.495576 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:57.503719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.505113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.505966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.507009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:57.507568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:57.508254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:57.782629 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:57.785655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-23a6328e-5734-4241-af57-afa45958dcaa tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "POST /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.807016 Aug 24 05:46:57.786539 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 82/177] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:46:56 2022] POST /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:57.790434 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bb063b5e-0365-4f07-8a12-0dd7f7fffda4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.300734 Aug 24 05:46:57.791012 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 96/178] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:57 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:58.031988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:58.032690 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:58.044256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.046934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.047387 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.050159 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.051841 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.052304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.323849 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:58.333124 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-46d0bccb-9823-4ba7-bdee-41ff7ea9c8c9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.305686 Aug 24 05:46:58.333742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 83/179] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:58 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:58.439426 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-e07b6916-7665-409b-abfa-1916ac5f3c58 req-81759e22-e6fd-4f1a-af21-0b6a9d609616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c198bb7-5353-42ac-a4f6-288e19f2bf67", "tag": "ebbe769b-059a-45f1-80ab-47a55af6039b"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:58.456009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e07b6916-7665-409b-abfa-1916ac5f3c58 req-81759e22-e6fd-4f1a-af21-0b6a9d609616 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.456514 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e07b6916-7665-409b-abfa-1916ac5f3c58 req-81759e22-e6fd-4f1a-af21-0b6a9d609616 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.456949 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e07b6916-7665-409b-abfa-1916ac5f3c58 req-81759e22-e6fd-4f1a-af21-0b6a9d609616 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.474625 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-e07b6916-7665-409b-abfa-1916ac5f3c58 req-81759e22-e6fd-4f1a-af21-0b6a9d609616 service nova] Creating event network-changed:ebbe769b-059a-45f1-80ab-47a55af6039b for instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 on hv-cinder-85426 Aug 24 05:46:58.495220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-e07b6916-7665-409b-abfa-1916ac5f3c58 req-81759e22-e6fd-4f1a-af21-0b6a9d609616 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060465 Aug 24 05:46:58.500477 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 97/180] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:58.817838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:58.819003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:58.831347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.832069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.832601 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:58.833416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:58.834396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:58.835030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:59.158224 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:59.174762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9b802379-c292-49ee-97e4-d9a17bf92937 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.363066 Aug 24 05:46:59.175483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 84/181] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:58 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:59.354464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:59.355367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:59.365539 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:59.366050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:59.366758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:59.368777 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:59.369471 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:59.370068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:59.541214 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:59.551788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-43d7e9b8-bd2d-4166-a74c-23880478e1a4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.201765 Aug 24 05:46:59.552485 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 98/182] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:59 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:00.195846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:00.196454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:00.208362 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.209054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.211655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.212421 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.212889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.213323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.548316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:00.555920 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9e5ded40-a35f-4fed-8500-e651dc3965b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.363828 Aug 24 05:47:00.556633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 85/183] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:00 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:00.575032 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:00.575639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:00.581705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.582191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.582619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.583464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:00.584073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:00.584491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:00.781016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:00.797230 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-00e86f5d-7c6e-4e6a-9d37-b933b1e5ee26 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.225116 Aug 24 05:47:00.798721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 99/184] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:00 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:01.577730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:01.578375 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:01.580269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:01.581389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=8 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:01.587770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.588363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.588794 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.589662 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.590374 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.591063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.822090 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:01.828466 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:01.834787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:01.848045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.851237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ca42362b-7b7a-453b-8851-ec5b57a31407 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.277416 Aug 24 05:47:01.852303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.853445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 86/185] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:01 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:01.854552 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:01.856749 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:01.857674 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:01.858574 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:02.066635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:02.077180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d2aeb819-ab2f-4e2d-90db-bd409e1f21db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.261319 Aug 24 05:47:02.080072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 100/186] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:01 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:02.875865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:02.877199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:02.884621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:02.885188 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:02.885727 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:02.886510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:02.887048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:02.888062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:03.038459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:03.048593 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-377ef3cc-5d4a-4712-815c-988f0ae2e68e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.177080 Aug 24 05:47:03.049409 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 87/187] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:02 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:03.100911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:03.102724 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:03.111057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:03.111748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:03.112441 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:03.113367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:03.114036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:03.114677 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:03.252395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:03.260276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-614d5560-89be-4642-b7f1-260ab1937aca tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.163416 Aug 24 05:47:03.260848 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 101/188] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:03 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:03.871228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-86511122", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:03.923969 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] validate_networks() for None {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:47:04.072728 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:04.073642 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:04.081114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.082352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.082894 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.084036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.084148 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.084609 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.205233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:47:04.205681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:47:04.206146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:47:04.206545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:47:04.207580 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:47:04.217837 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.218316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.218747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.219459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.219905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.220319 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.239851 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Getting quotas for project 873d8330010249f58ac18c8e17946f6e. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:47:04.247211 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:04.251992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Getting quotas for user 2c9fa86b65ec431eb3f77cf2bfe5cda4 and project 873d8330010249f58ac18c8e17946f6e. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:47:04.256443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2106662e-d7f4-43dd-bf9f-00b42981eac7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.188150 Aug 24 05:47:04.257230 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 102/189] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:04 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:04.274718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:47:04.277037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:47:04.282314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:04.282914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:04.288606 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.289357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.289715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.290474 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:04.291056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:04.291623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:04.326597 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5a8c0f7b-50d9-4208-840d-556b4c210f4c tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.458983 Aug 24 05:47:04.327465 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 88/190] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:47:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:47:04.339097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1907a08c-1bb2-4897-89b2-9b922922d474 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:04.341729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1907a08c-1bb2-4897-89b2-9b922922d474 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:04.425121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1907a08c-1bb2-4897-89b2-9b922922d474 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:04.432794 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1907a08c-1bb2-4897-89b2-9b922922d474 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1213 microversion: 2.1 time: 0.098816 Aug 24 05:47:04.433357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 89/191] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:04 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:04.470223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:04.479573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f49a8a9f-ea51-483e-930f-26d40bbadf87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.201502 Aug 24 05:47:04.480181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 103/192] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:04 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:05.278314 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:05.278918 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:05.285229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.285780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.286255 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.286874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.287308 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.287711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.414549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:05.423049 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a9e9087c-270e-4dfe-be22-908007f2a836 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.149133 Aug 24 05:47:05.423628 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 90/193] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:05 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:05.455059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:05.455670 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:05.462388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.462898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.463327 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.464054 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.464507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.464934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.505185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:05.505817 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:05.512646 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.513075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.513502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.514207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:05.514651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:05.515056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:05.528395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:05.536630 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4d8caf35-d35e-4be2-8041-33bdd31bd3ad tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1217 microversion: 2.1 time: 0.085314 Aug 24 05:47:05.537449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 104/194] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:05 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:05.661595 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:05.670094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-54ce1101-454c-4f7c-b43d-fad76b1367b4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.171048 Aug 24 05:47:05.670877 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 91/195] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:05 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:06.443507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:06.444153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:06.450586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.451064 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.451496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.452175 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.452631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.453050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.560041 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:06.560684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:06.567156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.567633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.572114 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.572975 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.573460 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.573925 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.588198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:06.595875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-43fe2ca2-4bb8-423a-9f3a-87e01bff08ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.156189 Aug 24 05:47:06.596754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 105/196] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:06 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:06.640800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:06.648416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-dbea816b-938e-415d-a2cc-53c676a01022 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1209 microversion: 2.1 time: 0.093037 Aug 24 05:47:06.648987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 92/197] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:06 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:06.690976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:06.691585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:06.697552 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.698060 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.698522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.699204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:06.700444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:06.700891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:06.704907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:06.833259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:06.840951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a9d7d7e9-9137-4887-b79b-5127af6f6e46 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.153833 Aug 24 05:47:06.841518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 106/198] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:06 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:07.163432 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-547ca893-fdf6-496c-8585-8fecedfaea4c req-759c4952-32f7-4166-94ee-6ef533e72e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c198bb7-5353-42ac-a4f6-288e19f2bf67", "name": "network-vif-plugged", "status": "completed", "tag": "ebbe769b-059a-45f1-80ab-47a55af6039b"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:07.175890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-547ca893-fdf6-496c-8585-8fecedfaea4c req-759c4952-32f7-4166-94ee-6ef533e72e11 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.176964 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-547ca893-fdf6-496c-8585-8fecedfaea4c req-759c4952-32f7-4166-94ee-6ef533e72e11 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.177634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-547ca893-fdf6-496c-8585-8fecedfaea4c req-759c4952-32f7-4166-94ee-6ef533e72e11 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.195174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-547ca893-fdf6-496c-8585-8fecedfaea4c req-759c4952-32f7-4166-94ee-6ef533e72e11 service nova] Creating event network-vif-plugged:ebbe769b-059a-45f1-80ab-47a55af6039b for instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 on hv-cinder-85426 Aug 24 05:47:07.203514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-547ca893-fdf6-496c-8585-8fecedfaea4c req-759c4952-32f7-4166-94ee-6ef533e72e11 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043618 Aug 24 05:47:07.204558 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 93/199] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:07.619771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:07.620181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:07.626403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.627207 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.627686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.628753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.629345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.630002 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.669729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:07.670503 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:07.680565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.681980 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.682570 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.683788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.684427 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.684857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.756334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:07.764813 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a60d1123-2bf3-4281-a4d0-6ac632dfe836 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1273 microversion: 2.1 time: 0.100072 Aug 24 05:47:07.765382 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 94/200] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:07 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:07.770102 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:07.770780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:07.776724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.777415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.778439 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.779143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.779594 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.780017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.792366 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:07.801944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fbaf35fd-a2f5-4d4a-91fe-f01bed14d28d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.186839 Aug 24 05:47:07.802610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 107/201] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:07 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:07.807449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:47:07.862596 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:07.863554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:07.870847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.871436 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.872767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.873717 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.874375 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.874997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.907229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-35aeb16b-6497-452c-910c-605874327f28 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "DELETE /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 204 len: 0 microversion: 2.1 time: 0.140341 Aug 24 05:47:07.911214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 95/202] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:47:07 2022] DELETE /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:47:07.920471 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:07.921280 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:07.929047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.929885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.930472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:07.931298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:07.931817 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:07.932328 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:08.044773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:08.052811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-64ca07b5-840f-451b-9b1d-fef0ce25d2c1 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.194371 Aug 24 05:47:08.053406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 108/203] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:07 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:08.184274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:08.192415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6291d6f9-7829-4b34-bc52-ddda775d085f tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1553 microversion: 2.1 time: 0.279018 Aug 24 05:47:08.192987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 96/204] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:07 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:08.785551 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:08.786191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:08.792058 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:08.792538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:08.792974 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:08.793770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:08.794224 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:08.794646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:08.826472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:08.828542 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:08.835042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:08.835590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:08.836193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:08.836917 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:08.837364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:08.837809 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:08.866994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:08.890317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9419ebae-a1f8-40df-b365-1223f9bd9fca tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1271 microversion: 2.1 time: 0.108057 Aug 24 05:47:08.891524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 109/205] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:08 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:08.994414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:09.002959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d7451509-d235-4986-a796-ddd86a5be03b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.182532 Aug 24 05:47:09.003603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 97/206] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:08 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:09.075172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:09.075769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:09.081690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.082170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.082638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.083417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.083872 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.084296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.216888 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:09.217785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:09.219013 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:09.225363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.225948 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.226621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.226821 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-91f562e9-0192-4c98-9ec3-b6849e49224d tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.156281 Aug 24 05:47:09.227397 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 110/207] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:09 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:09.227522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.228040 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.228454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.363184 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:09.366953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:09.373149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d2aeb123-9afa-4e01-8b47-00e5cc154f65 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1553 microversion: 2.1 time: 0.161402 Aug 24 05:47:09.373753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 98/208] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:09 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:09.912115 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:09.912807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:09.919522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.920558 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.920558 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.921266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:09.921737 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:09.922161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:09.989557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:09.998191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c3dcad29-4b9e-4892-a100-18939659dd14 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1271 microversion: 2.1 time: 0.089787 Aug 24 05:47:09.999139 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 111/209] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:09 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:10.024713 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:10.025355 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:10.032621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.033090 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.033622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.034231 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.034679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.035161 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.216959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:10.224978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c0bd3ec8-f391-43bc-a4ee-b7d6faf0781c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.204645 Aug 24 05:47:10.225658 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 99/210] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:10 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:10.258215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:10.259204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:10.269335 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.270050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.270965 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.271866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.272468 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.273037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.396146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:10.397140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:10.404278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.405295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.405961 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.407341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:10.407341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:10.407843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:10.425155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:10.433067 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f0519dc4-cc5d-4a56-ad61-013e2a8cbb47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.181387 Aug 24 05:47:10.447344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 112/211] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:10 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:10.649005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:10.658596 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fa284ab4-5270-4c26-9302-7b18c78858a8 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1553 microversion: 2.1 time: 0.268012 Aug 24 05:47:10.659181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 100/212] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:10 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:11.022480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:11.025756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:11.034633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.035534 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.036222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.037166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.038045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.038977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.248138 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:11.249406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:11.256000 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.256822 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.257471 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.258700 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.259370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.259998 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.412100 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:11.421873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0acb7192-2ac0-4871-ba36-23ded78f779f tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.403713 Aug 24 05:47:11.434796 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 113/213] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:11 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:11.457016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:11.458018 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:11.467110 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.467851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.468582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.469460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.470065 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.470656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.607092 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:11.617762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5b59d851-c40a-427f-aeaa-4d11f537a541 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.374767 Aug 24 05:47:11.618767 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 101/214] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:11 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:11.680297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:11.681154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:11.689450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.691055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.691567 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.692384 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:11.693056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:11.693878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:11.752745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:11.767351 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a8fa89b6-204d-437f-b4a0-99d0218908d4 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1314 microversion: 2.1 time: 0.315154 Aug 24 05:47:11.769037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 114/215] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:11 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:11.998744 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-1f73328a-1f37-4992-bff5-cb7266a5fc0c req-471e0317-0284-4d86-ac98-500568068d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52931398-a2b5-484b-aae3-486013e7ab2e", "tag": "f25d8381-41b8-4465-926e-af08de476a75"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:12.009695 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-1f73328a-1f37-4992-bff5-cb7266a5fc0c req-471e0317-0284-4d86-ac98-500568068d57 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.010624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-1f73328a-1f37-4992-bff5-cb7266a5fc0c req-471e0317-0284-4d86-ac98-500568068d57 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.011341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-1f73328a-1f37-4992-bff5-cb7266a5fc0c req-471e0317-0284-4d86-ac98-500568068d57 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.024055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-1f73328a-1f37-4992-bff5-cb7266a5fc0c req-471e0317-0284-4d86-ac98-500568068d57 service nova] Creating event network-changed:f25d8381-41b8-4465-926e-af08de476a75 for instance 52931398-a2b5-484b-aae3-486013e7ab2e on hv-cinder-85426 Aug 24 05:47:12.029822 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-1f73328a-1f37-4992-bff5-cb7266a5fc0c req-471e0317-0284-4d86-ac98-500568068d57 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035100 Aug 24 05:47:12.030419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 115/216] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:12.155269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:12.164609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-15a2d624-da95-4649-8ee6-8db61b084702 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1553 microversion: 2.1 time: 0.488470 Aug 24 05:47:12.178144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 102/217] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:11 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1553 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:12.448378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:12.449396 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:12.458135 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.458991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.459495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.460426 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.461788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.461788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.645812 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:12.647560 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:12.659848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.661198 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.662078 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.663212 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.663889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.664900 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.669114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:12.680283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a0bc815b-40fc-45e1-b3d2-58d9ae06ef26 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.239803 Aug 24 05:47:12.681276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 116/218] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:12 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:12.792419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:12.794152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:12.802555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.803381 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.804363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:12.805701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:12.806614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:12.807260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.007090 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:13.015778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3bf70ae0-42c4-4b37-8036-014f271310cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.376574 Aug 24 05:47:13.019190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 103/219] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:12 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:13.099637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:13.116533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-da8a3517-ef4e-498d-bc23-a3c505d38b47 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1498 microversion: 2.1 time: 0.331161 Aug 24 05:47:13.117294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 117/220] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:12 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:13.187814 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:13.188551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:13.196424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.199870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.200482 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.201212 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.201701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.202129 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.294792 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:13.303270 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8e0a6de4-8706-4e44-8c85-4dbae79c4f48 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1345 microversion: 2.1 time: 0.119445 Aug 24 05:47:13.304401 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 104/221] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:13 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1345 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:13.705381 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:13.706112 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:13.713350 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.717964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.718441 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.719196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.724132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.724624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.885025 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:13.895713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-998f4161-b88a-48df-b815-dd5cf20e83c6 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.194984 Aug 24 05:47:13.896639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 118/222] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:13 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:13.909544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:13.910177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:13.917546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.918687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.919239 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.920031 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:13.920535 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:13.920992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:13.948140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:47:14.035390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9225c392-4f5d-4bb9-a9f4-5cb1c36fc5bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 204 len: 0 microversion: 2.1 time: 0.127244 Aug 24 05:47:14.036642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 105/223] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:47:13 2022] DELETE /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:47:14.041027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:14.041759 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:14.048448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:14.049271 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.049982 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:14.050153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.050730 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.051587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.052337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.052988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.061450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.062228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.062875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.064148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.065281 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.065953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.228380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:14.228909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:14.238632 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6b39c224-c468-4c6a-9585-ff7ee2e0172b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.201671 Aug 24 05:47:14.239713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 119/224] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:14 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:14.244924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-901dc378-35c6-4b56-908e-9a5ecab9b03a req-0e719ade-3478-460d-a02b-27bf5936133f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e7b469-f365-451f-95bc-812608b89ecc", "name": "network-vif-deleted", "tag": "b4d50320-e71a-4b22-9b7d-c494b0c340ce"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:14.278469 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-901dc378-35c6-4b56-908e-9a5ecab9b03a req-0e719ade-3478-460d-a02b-27bf5936133f service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.278989 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-901dc378-35c6-4b56-908e-9a5ecab9b03a req-0e719ade-3478-460d-a02b-27bf5936133f service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.279430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-901dc378-35c6-4b56-908e-9a5ecab9b03a req-0e719ade-3478-460d-a02b-27bf5936133f service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.300836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-901dc378-35c6-4b56-908e-9a5ecab9b03a req-0e719ade-3478-460d-a02b-27bf5936133f service nova] Creating event network-vif-deleted:b4d50320-e71a-4b22-9b7d-c494b0c340ce for instance 01e7b469-f365-451f-95bc-812608b89ecc on hv-cinder-85426 Aug 24 05:47:14.306994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-901dc378-35c6-4b56-908e-9a5ecab9b03a req-0e719ade-3478-460d-a02b-27bf5936133f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065661 Aug 24 05:47:14.307595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 120/225] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:14.311869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:14.321810 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c9e8ca4a-78ec-4fef-8a68-6ec4603c1985 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1504 microversion: 2.1 time: 0.279460 Aug 24 05:47:14.322474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 106/226] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:14 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:14.329126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:14.329951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:14.336427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.337129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.337590 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.338262 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.338711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.339124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.374783 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.375387 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.375897 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.376421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lazy-loading 'fault' on Instance uuid 01e7b469-f365-451f-95bc-812608b89ecc {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:14.424288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:14.435130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3a587a0f-9be1-435f-b818-a3a4b3510af5 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1350 microversion: 2.1 time: 0.114138 Aug 24 05:47:14.435921 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 121/227] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:14 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:14.916232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:14.916836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:14.918808 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=8 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:14.925264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.925385 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.925772 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:14.926514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:14.927085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:14.927512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.069307 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:15.077915 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-829e427a-2c63-49ff-9272-311b48b0baa5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.165547 Aug 24 05:47:15.079155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 107/228] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:14 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:15.259144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:15.260012 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:15.268180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:15.268877 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:15.269320 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.270231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:15.270987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:15.271528 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.345909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:15.347051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:15.354504 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:15.355502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:15.356984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.357849 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:15.358190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:15.358871 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.528629 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:15.552033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a3f273ed-c648-4d93-94ab-20c8d1b7588f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.296644 Aug 24 05:47:15.552623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 122/229] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:15 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:15.567835 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:15.569237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:15.584155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:15.584908 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:15.585410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.586219 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:15.586688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:15.587102 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.642524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:15.643254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:15.643924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:15.644518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lazy-loading 'fault' on Instance uuid 01e7b469-f365-451f-95bc-812608b89ecc {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:15.647705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:15.689191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:15.700249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5649a655-de7b-4200-be1a-0ce20e20803e tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1350 microversion: 2.1 time: 0.136327 Aug 24 05:47:15.700897 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 123/230] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:15 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:15.783371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:15.791142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-45218955-623a-48a0-8591-117014ec10c8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1504 microversion: 2.1 time: 0.450736 Aug 24 05:47:15.791710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 108/231] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:15 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:16.098709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:16.099362 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:16.105761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.106612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.107220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.108945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.109621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.110242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.254235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:16.265952 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9e00ca41-8f80-4230-ac6e-e20ba426bcaa tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.171078 Aug 24 05:47:16.266749 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 124/232] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:16 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:16.573338 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:16.573993 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:16.581389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.581910 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.582472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.583274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.583752 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.584180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.724789 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:16.726452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:16.729896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:16.735393 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.735876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.736615 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.737430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.738196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.738914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.739327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-74f2d937-6a46-4199-8b5f-e2269e3e00df tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.170230 Aug 24 05:47:16.740254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 109/233] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:16 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:16.786636 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.787202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.787633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.788429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lazy-loading 'fault' on Instance uuid 01e7b469-f365-451f-95bc-812608b89ecc {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:16.817119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:16.820533 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:16.827826 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.828526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.829114 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.830064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:16.830693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:16.831274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:16.846362 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:16.861136 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0e821597-8dd4-4559-b02d-7f1f8d12a1c3 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1350 microversion: 2.1 time: 0.140248 Aug 24 05:47:16.863413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 125/234] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:16 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:17.054407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:17.062284 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-77c30a2f-8fd2-4d07-8e4f-60aa86e0c57b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1504 microversion: 2.1 time: 0.253894 Aug 24 05:47:17.062857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 110/235] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:16 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:17.293960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:17.295158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:17.301170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.301923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.302570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.303448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.304079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.304692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.444548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:17.453376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-88c4e7cf-d08e-45fb-994c-9f5133323b3d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.163866 Aug 24 05:47:17.454293 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 126/236] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:17 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:17.761180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:17.762922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:17.766770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:17.774361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.774928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.775362 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.776067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.776517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.777057 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.883410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:17.884021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:17.890466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.890948 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.891384 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.892073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.892530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.892951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.917830 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:17.925820 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-12e268c4-cd44-43ca-bd37-8df41511f18b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.169417 Aug 24 05:47:17.926402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 111/237] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:17 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:17.926883 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:17.927447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:17.927879 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:17.928319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lazy-loading 'fault' on Instance uuid 01e7b469-f365-451f-95bc-812608b89ecc {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:17.971348 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:17.979911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3beeec36-0b59-4d9d-91e6-e557b970affe tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1350 microversion: 2.1 time: 0.100262 Aug 24 05:47:17.980488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 127/238] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:17 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:18.083219 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:18.083915 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:18.089802 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.090308 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.090768 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:18.091507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.092174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.092584 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:18.218182 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:18.225968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-dbcec2c2-0190-4d89-b77d-151c167cd693 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1504 microversion: 2.1 time: 0.146573 Aug 24 05:47:18.226540 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 112/239] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:18 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:18.474600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:18.475679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:18.482368 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.482854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.483541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:18.484227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.484677 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.485100 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:18.609505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:18.617039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e2b546b9-9fd4-48a9-8181-9e21b60dbfc2 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.146351 Aug 24 05:47:18.617622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 128/240] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:18 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:18.947101 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:18.947716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:18.954199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.954715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.955149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:18.955844 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:18.956297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:18.956725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.001096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:19.001659 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:19.007479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:19.007958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:19.008440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.009193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:19.009643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:19.010179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.040589 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:19.041092 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:19.041513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.041980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lazy-loading 'fault' on Instance uuid 01e7b469-f365-451f-95bc-812608b89ecc {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:19.082716 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '914bea2efd334e6c8dc31698dfabbf8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf4c294b65d453d8d0b9cd6fcd76976', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:19.091477 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-99fd69ef-5c7e-4120-b7b6-be2b82ad5197 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 200 len: 1350 microversion: 2.1 time: 0.094922 Aug 24 05:47:19.092054 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 129/241] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:18 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:19.093726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:19.097073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:19.102025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8645c4d1-dcf1-4f0e-8738-ae3f87f5a3c2 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.158883 Aug 24 05:47:19.102636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 113/242] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:18 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:19.247502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:19.248108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:19.250986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:19.254972 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:19.255372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:19.255800 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.256484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:19.256937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:19.257354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.389926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:19.397434 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a66fbb18-5f17-40b1-8f43-9c28e6c58a87 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1504 microversion: 2.1 time: 0.154066 Aug 24 05:47:19.398028 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 130/243] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:19 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:19.642548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:19.643235 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:19.652010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:19.652847 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:19.653013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.653864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:19.654382 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:19.655319 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:19.945949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:19.956840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-414641e9-edfa-4746-b1ce-b6de01c49845 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.322225 Aug 24 05:47:19.959433 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 114/244] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:19 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:20.114379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:20.115067 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:20.123651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:20.123857 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.124210 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.124374 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:20.124645 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.125425 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.125906 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.126379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.131093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.135120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.135601 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.136343 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.136856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.137289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.160968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] HTTP exception thrown: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Request method failure captured: Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc HTTP/1.1 Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsaTSNGZBv5zI2NWW7-HGq9quq7X0Y-1bQQrl_8VvfDkuuFrxGmPpZO0qUGBwFsf-lTDcjggUlAClzA4IRvamQbq9JiWa2iBG0e6z_mO638VysxH85KgchcGJMNyazcR-6h6iJYCZ0A059LXNX6aCwiJl49XS5gkd9BoKvE-76EoBE Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:47:20.168753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 914bea2efd334e6c8dc31698dfabbf8e Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.170220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '01e7b469-f365-451f-95bc-812608b89ecc'} Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:20.170943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.172178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.175447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Returning 404 to user: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:20.175607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-662961ca-d63a-429b-9652-89b34918fe15 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 404 len: 111 microversion: 2.1 time: 0.066537 Aug 24 05:47:20.177152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 131/245] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:20 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:47:20.322806 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-145f6b1d-e1ae-48e1-ba51-91e912d11cfd req-1935279c-cd1b-4e0f-b9b7-ebad8032b83d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c198bb7-5353-42ac-a4f6-288e19f2bf67", "name": "network-vif-deleted", "tag": "ebbe769b-059a-45f1-80ab-47a55af6039b"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:20.338082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-145f6b1d-e1ae-48e1-ba51-91e912d11cfd req-1935279c-cd1b-4e0f-b9b7-ebad8032b83d service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.338679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-145f6b1d-e1ae-48e1-ba51-91e912d11cfd req-1935279c-cd1b-4e0f-b9b7-ebad8032b83d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.339195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-145f6b1d-e1ae-48e1-ba51-91e912d11cfd req-1935279c-cd1b-4e0f-b9b7-ebad8032b83d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.350545 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-145f6b1d-e1ae-48e1-ba51-91e912d11cfd req-1935279c-cd1b-4e0f-b9b7-ebad8032b83d service nova] Creating event network-vif-deleted:ebbe769b-059a-45f1-80ab-47a55af6039b for instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 on hv-cinder-85426 Aug 24 05:47:20.356705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-145f6b1d-e1ae-48e1-ba51-91e912d11cfd req-1935279c-cd1b-4e0f-b9b7-ebad8032b83d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037841 Aug 24 05:47:20.358571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 132/246] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:20.409357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:20.413117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:20.413299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:20.422551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3b74a076-eac6-4e82-9315-2926a1e7883a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.303190 Aug 24 05:47:20.423796 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.424463 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.425072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.426132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.426755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.427925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.435668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 115/247] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:20 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:20.442508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:20.443449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:20.452136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.452878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.453787 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.455163 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.456099 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.456812 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.476055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] HTTP exception thrown: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Request method failure captured: Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc/os-volume_attachments HTTP/1.1 Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsaTSNGZBv5zI2NWW7-HGq9quq7X0Y-1bQQrl_8VvfDkuuFrxGmPpZO0qUGBwFsf-lTDcjggUlAClzA4IRvamQbq9JiWa2iBG0e6z_mO638VysxH85KgchcGJMNyazcR-6h6iJYCZ0A059LXNX6aCwiJl49XS5gkd9BoKvE-76EoBE Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:47:20.489772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 914bea2efd334e6c8dc31698dfabbf8e Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.491080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'server_id': '01e7b469-f365-451f-95bc-812608b89ecc'} Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:20.491924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:20.493459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:20.494927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Returning 404 to user: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:20.494927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-62eee1ff-b38c-4f34-a0df-a1a576e8841a tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.101320 Aug 24 05:47:20.494927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 133/248] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:47:20 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc/os-volume_attachments => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:47:20.497009 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.497490 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.498002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.498687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lazy-loading 'fault' on Instance uuid 8c198bb7-5353-42ac-a4f6-288e19f2bf67 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:20.561036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:20.579220 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e3b327c7-fff2-4d7e-b4ce-44fd71d0246f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 200 len: 1304 microversion: 2.1 time: 0.142003 Aug 24 05:47:20.579707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 116/249] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:20 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:20.979600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:20.980212 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:20.987069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.987546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.987970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:20.988657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:20.989131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:20.989638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.132028 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:21.140048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a584d155-870a-4c4f-ae2d-d5da8b4aa642 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.164430 Aug 24 05:47:21.140617 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 134/250] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:20 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:21.449662 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:21.450508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:21.457344 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.457989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.458542 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.459532 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.461318 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.461911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.522181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-e94650a2-256a-458c-bdf9-5ac17fffff32 req-8c2c7d0e-60da-4ac1-954f-2bc74f1b4c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52931398-a2b5-484b-aae3-486013e7ab2e", "name": "network-vif-plugged", "status": "completed", "tag": "f25d8381-41b8-4465-926e-af08de476a75"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:21.539011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e94650a2-256a-458c-bdf9-5ac17fffff32 req-8c2c7d0e-60da-4ac1-954f-2bc74f1b4c29 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.539816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e94650a2-256a-458c-bdf9-5ac17fffff32 req-8c2c7d0e-60da-4ac1-954f-2bc74f1b4c29 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.541118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e94650a2-256a-458c-bdf9-5ac17fffff32 req-8c2c7d0e-60da-4ac1-954f-2bc74f1b4c29 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.559175 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-e94650a2-256a-458c-bdf9-5ac17fffff32 req-8c2c7d0e-60da-4ac1-954f-2bc74f1b4c29 service nova] Creating event network-vif-plugged:f25d8381-41b8-4465-926e-af08de476a75 for instance 52931398-a2b5-484b-aae3-486013e7ab2e on hv-cinder-85426 Aug 24 05:47:21.565806 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-e94650a2-256a-458c-bdf9-5ac17fffff32 req-8c2c7d0e-60da-4ac1-954f-2bc74f1b4c29 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048901 Aug 24 05:47:21.567063 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 135/251] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:21.614437 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:21.615734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8c198bb7-5353-42ac-a4f6-288e19f2bf67] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:21.635415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.636130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.637069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.638171 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.645287 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.645950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.651827 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:21.661100 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-59aa03de-4009-4360-bf20-2c530281e8c8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.216114 Aug 24 05:47:21.661706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 117/252] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:21 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:21.682487 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] HTTP exception thrown: Instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 could not be found. Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Request method failure captured: Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 HTTP/1.1 Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbtHsTxno0uZBp27tmN3Ws1iukVBgM9kscA6qoq76F-DM8SirwZqUUW-eIpmSkWUa2-C2Z3n2-RjkOZKKMH6auMHwheDcY3dabQQjGRV8zHZnsBKYg7BkphCiJp2dxNn9CAxigAqESFZbRpgohUQ2vP5nBdI90KvfMX02dW7RubMpLs Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 82f6c80e9245427aad8acd3c8bd5efbc Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesActionsTest-319305743 Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:47:21.685296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesActionsTest-319305743 Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 82f6c80e9245427aad8acd3c8bd5efbc Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesActionsTest-319305743 Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesActionsTest-319305743-project Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: a621860d8fcb4327820ce6b802e6a725 Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesActionsTest-319305743-project Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 could not be found. Aug 24 05:47:21.686760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '8c198bb7-5353-42ac-a4f6-288e19f2bf67'} Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 could not be found. Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:21.687631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 could not be found. Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 could not be found. Aug 24 05:47:21.688881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.689946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Returning 404 to user: Instance 8c198bb7-5353-42ac-a4f6-288e19f2bf67 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:21.689946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c37f5946-28b1-4cd1-9f06-ea9dae8d34fc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67" status: 404 len: 111 microversion: 2.1 time: 0.090129 Aug 24 05:47:21.689946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 136/253] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:21 2022] GET /compute/v2.1/servers/8c198bb7-5353-42ac-a4f6-288e19f2bf67 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:47:21.743274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:21.743833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:21.751227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.752216 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.752661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.755262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.755815 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.756337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.773364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] HTTP exception thrown: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Request method failure captured: Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc HTTP/1.1 Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsaTSNGZBv5zI2NWW7-HGq9quq7X0Y-1bQQrl_8VvfDkuuFrxGmPpZO0qUGBwFsf-lTDcjggUlAClzA4IRvamQbq9JiWa2iBG0e6z_mO638VysxH85KgchcGJMNyazcR-6h6iJYCZ0A059LXNX6aCwiJl49XS5gkd9BoKvE-76EoBE Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:47:21.781936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 914bea2efd334e6c8dc31698dfabbf8e Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.783063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '01e7b469-f365-451f-95bc-812608b89ecc'} Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:21.783682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.784704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.785853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Returning 404 to user: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:21.785853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5bb74000-cd18-4568-b131-a38814c353ad tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "DELETE /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 404 len: 111 microversion: 2.1 time: 0.042110 Aug 24 05:47:21.785853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 118/254] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:47:21 2022] DELETE /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:47:21.794297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:21.795561 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] [instance: 01e7b469-f365-451f-95bc-812608b89ecc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:21.806732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.807568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.808045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.809347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:21.810600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:21.811302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:21.827761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] HTTP exception thrown: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Request method failure captured: Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc HTTP/1.1 Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsaTSNGZBv5zI2NWW7-HGq9quq7X0Y-1bQQrl_8VvfDkuuFrxGmPpZO0qUGBwFsf-lTDcjggUlAClzA4IRvamQbq9JiWa2iBG0e6z_mO638VysxH85KgchcGJMNyazcR-6h6iJYCZ0A059LXNX6aCwiJl49XS5gkd9BoKvE-76EoBE Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:47:21.829276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/caf4c294b65d453d8d0b9cd6fcd76976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: caf4c294b65d453d8d0b9cd6fcd76976 Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-DeleteServersTestJSON-2025322162 Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 914bea2efd334e6c8dc31698dfabbf8e Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-DeleteServersTestJSON-2025322162-project Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.830721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '01e7b469-f365-451f-95bc-812608b89ecc'} Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:21.835866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. Aug 24 05:47:21.837321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:21.838807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] Returning 404 to user: Instance 01e7b469-f365-451f-95bc-812608b89ecc could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:21.838807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c4a24f18-7337-49b4-a519-c91e4c687184 tempest-DeleteServersTestJSON-2025322162 tempest-DeleteServersTestJSON-2025322162-project] 10.222.0.73 "GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc" status: 404 len: 111 microversion: 2.1 time: 0.040471 Aug 24 05:47:21.838807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 137/255] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:21 2022] GET /compute/v2.1/servers/01e7b469-f365-451f-95bc-812608b89ecc => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:47:21.874003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1747951070", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "networks": [{"uuid": "558b67e1-5aa8-4b40-be83-48a482e5c09e"}]}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:21.938643 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] validate_networks() for [('558b67e1-5aa8-4b40-be83-48a482e5c09e', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:47:22.160439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:22.161033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:22.171885 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.172612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.173048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:22.173782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.174229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.174643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:22.299278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:47:22.299773 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:47:22.300323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:47:22.300800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:47:22.301298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:47:22.310293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.310877 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.311377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:22.312300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.312829 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.313327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:22.331331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Getting quotas for project 82f6c80e9245427aad8acd3c8bd5efbc. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:47:22.335515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Getting quotas for user a621860d8fcb4327820ce6b802e6a725 and project 82f6c80e9245427aad8acd3c8bd5efbc. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:47:22.349209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:47:22.351788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:47:22.408226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ebc1ebb0-d938-4b0c-b326-5a998a9362e8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542027 Aug 24 05:47:22.415001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 119/256] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:47:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:47:22.416442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:22.421016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b5eed390-f556-4224-9d53-f86a89f033a3 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:22.421786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b5eed390-f556-4224-9d53-f86a89f033a3 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:22.433257 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b7a80d83-9076-4af2-ba8b-9eaa5e88d470 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1313 microversion: 2.1 time: 0.276554 Aug 24 05:47:22.438110 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 138/257] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:22 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:22.483880 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b5eed390-f556-4224-9d53-f86a89f033a3 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:22.492466 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b5eed390-f556-4224-9d53-f86a89f033a3 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1214 microversion: 2.1 time: 0.075431 Aug 24 05:47:22.505592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 120/258] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:22 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:22.684771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:22.685704 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:22.692147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.692901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.693330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:22.694105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:22.694555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:22.694983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.064217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:23.074360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8afee00a-1d97-4686-8137-9bb56b4051d7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.394340 Aug 24 05:47:23.082332 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 139/259] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:22 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:23.462064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:23.462843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:23.470261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.471074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.471739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.472660 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.473316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.473992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.516485 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:23.517655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:23.524346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.525371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.526075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.526928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.527583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.528157 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.648696 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:23.658975 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6b2567c5-f367-4a2d-b729-c13595169be8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1266 microversion: 2.1 time: 0.146679 Aug 24 05:47:23.659647 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 140/260] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:23 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:23.696318 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:23.704734 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-af4e8203-d8aa-489b-887b-becb004828ec tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1462 microversion: 2.1 time: 0.247775 Aug 24 05:47:23.705310 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 121/261] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:23 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1462 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:23.756765 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:23.757678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:23.764241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.764790 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.765286 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.766127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.766705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.767241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.797389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:47:23.881215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:23.931601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-babf53b9-7f79-4cf7-9116-9487ca7f4868 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "DELETE /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 204 len: 0 microversion: 2.1 time: 0.179253 Aug 24 05:47:23.937627 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 141/262] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:47:23 2022] DELETE /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:47:23.942311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:23.943144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:23.952930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.953723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.954364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:23.955428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:23.955922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:23.956518 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:24.108685 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:24.111186 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:24.131245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:24.132604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:24.133045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:24.135585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:24.136232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:24.136708 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:24.275641 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:24.283947 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-724144cf-e62e-4920-b291-b83b0bb262da tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1468 microversion: 2.1 time: 0.345393 Aug 24 05:47:24.284528 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 122/263] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:23 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1468 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:24.372692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:24.383736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f8c8fa5e-b31a-4ee9-ba7f-15b701360243 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.291641 Aug 24 05:47:24.384334 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 142/264] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:24 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:24.681901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:24.682798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:24.690339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:24.691065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:24.691710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:24.692425 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:24.693109 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:24.693872 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:24.829508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:24.840073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1f8a93f7-c58a-4979-a791-d4f1587d6300 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1266 microversion: 2.1 time: 0.161670 Aug 24 05:47:24.841168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 123/265] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:24 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:25.310578 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:25.312097 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:25.321452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.322274 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.325494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.326427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.327155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.327845 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.405502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:25.406321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:25.416084 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.416729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.421206 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.422032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.422517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.423032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.598062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:25.606912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-81d2c093-0885-4b9d-b8af-51e3001bb00e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.205795 Aug 24 05:47:25.611293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 124/266] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:25 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:25.646394 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:25.655313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-51869842-43fb-44d5-afec-49002631a1c5 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1468 microversion: 2.1 time: 0.354389 Aug 24 05:47:25.656272 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 143/267] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:25 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1468 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:25.865501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:25.866518 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:25.874988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.875725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.876335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.877254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:25.877890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:25.878586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:25.965131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:25.973821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4c42564a-cbb6-4212-8e16-e254e5979dd2 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1266 microversion: 2.1 time: 0.112980 Aug 24 05:47:25.974409 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 125/268] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:25 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:26.631050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:26.631584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:26.639987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:26.640690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:26.641192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:26.641938 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:26.642730 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:26.643281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:26.684106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:26.685058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:26.703911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:26.704686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:26.705719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:26.707011 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:26.707829 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:26.708412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:26.874347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:26.885119 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-08ca8294-824b-4ae4-9391-d80774aee057 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.257794 Aug 24 05:47:26.901935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 144/269] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:26 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:26.997752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:26.998364 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:27.006447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:27.007135 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:27.007704 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:27.008745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:27.009246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:27.009803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:27.113676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:27.123003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:27.139047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6603ee2d-d1c5-4c3e-8012-73e37d4e1d7d tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1468 microversion: 2.1 time: 0.466046 Aug 24 05:47:27.149618 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 126/270] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:26 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1468 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:27.149793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a2d493d6-3675-4696-a376-9550bc3af13f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1272 microversion: 2.1 time: 0.149678 Aug 24 05:47:27.154989 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 145/271] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:26 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:27.549759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-4513ea78-544f-4ff9-b134-e1ac39519b5d req-02c07cd8-051f-4089-b69a-2ca4ce7f9d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52931398-a2b5-484b-aae3-486013e7ab2e", "name": "network-vif-deleted", "tag": "f25d8381-41b8-4465-926e-af08de476a75"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:27.573739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4513ea78-544f-4ff9-b134-e1ac39519b5d req-02c07cd8-051f-4089-b69a-2ca4ce7f9d15 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:27.574317 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4513ea78-544f-4ff9-b134-e1ac39519b5d req-02c07cd8-051f-4089-b69a-2ca4ce7f9d15 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:27.575492 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4513ea78-544f-4ff9-b134-e1ac39519b5d req-02c07cd8-051f-4089-b69a-2ca4ce7f9d15 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:27.599514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-4513ea78-544f-4ff9-b134-e1ac39519b5d req-02c07cd8-051f-4089-b69a-2ca4ce7f9d15 service nova] Creating event network-vif-deleted:f25d8381-41b8-4465-926e-af08de476a75 for instance 52931398-a2b5-484b-aae3-486013e7ab2e on hv-cinder-85426 Aug 24 05:47:27.606510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-4513ea78-544f-4ff9-b134-e1ac39519b5d req-02c07cd8-051f-4089-b69a-2ca4ce7f9d15 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059976 Aug 24 05:47:27.607893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 127/272] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:47:27.908202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:27.909381 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:27.915924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:27.916397 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:27.916820 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:27.917548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:27.918626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:27.919043 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.060824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:28.069081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fa4e754b-23ad-4296-8f72-ab448213a703 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.165760 Aug 24 05:47:28.069684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 146/273] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:27 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:28.161495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:28.163535 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:28.164143 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:28.164831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:28.174576 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:28.175003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:28.175125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:28.175586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.176050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:28.176163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:28.176603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:28.176868 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.176999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.178142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:28.178870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:28.179480 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.226802 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:28.228226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:28.229687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:28.232780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lazy-loading 'fault' on Instance uuid 52931398-a2b5-484b-aae3-486013e7ab2e {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:28.312776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c9fa86b65ec431eb3f77cf2bfe5cda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873d8330010249f58ac18c8e17946f6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:28.323162 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8e3b2b1a-e072-4975-9845-fc83ec88228b tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 200 len: 1303 microversion: 2.1 time: 0.166183 Aug 24 05:47:28.325541 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 128/274] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:28 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 1303 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:28.401448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:28.413449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6fd04548-f23e-4ab5-839f-5fa815a5e28a tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.253404 Aug 24 05:47:28.414001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 147/275] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:28 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:29.093263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:29.093833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:29.100367 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.100856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.101297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.102187 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.102649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.103190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.346940 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:29.348454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] [instance: 52931398-a2b5-484b-aae3-486013e7ab2e] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:29.354980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.356200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.359554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.359554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.359554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.359554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.380706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] HTTP exception thrown: Instance 52931398-a2b5-484b-aae3-486013e7ab2e could not be found. Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Request method failure captured: Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e HTTP/1.1 Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbtWkyPaY3eCm1AIp1yidJnWj1lIuBMeBGf2VWhLBWtSaqoU5fnufhjgo3NB-KE6-ORQVegepdrV_J2sCSqZz3oTEnh8le6VevGruwjLN4pyctBkphZUheFo3eDXyrcjWYzhmFlCxMCyXULxN7QA9oZOhwXDXfN61H4MwDyMmktuuhY Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 873d8330010249f58ac18c8e17946f6e Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesNegativeTest-1831612232 Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:47:29.390747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_873d8330010249f58ac18c8e17946f6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/873d8330010249f58ac18c8e17946f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/873d8330010249f58ac18c8e17946f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/873d8330010249f58ac18c8e17946f6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesNegativeTest-1831612232 Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 873d8330010249f58ac18c8e17946f6e Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesNegativeTest-1831612232 Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesNegativeTest-1831612232-project Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 2c9fa86b65ec431eb3f77cf2bfe5cda4 Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesNegativeTest-1831612232-project Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 52931398-a2b5-484b-aae3-486013e7ab2e could not be found. Aug 24 05:47:29.391954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '52931398-a2b5-484b-aae3-486013e7ab2e'} Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52931398-a2b5-484b-aae3-486013e7ab2e could not be found. Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:29.392719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52931398-a2b5-484b-aae3-486013e7ab2e could not be found. Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52931398-a2b5-484b-aae3-486013e7ab2e could not be found. Aug 24 05:47:29.394072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:47:29.397226 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] Returning 404 to user: Instance 52931398-a2b5-484b-aae3-486013e7ab2e could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:29.397226 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-21c5d939-9e82-4e3a-ba1a-4e28d16271f0 tempest-VolumesNegativeTest-1831612232 tempest-VolumesNegativeTest-1831612232-project] 10.222.0.73 "GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e" status: 404 len: 111 microversion: 2.1 time: 0.049711 Aug 24 05:47:29.399012 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 148/276] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:29 2022] GET /compute/v2.1/servers/52931398-a2b5-484b-aae3-486013e7ab2e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:47:29.426211 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:29.437524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:29.438257 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:29.439689 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a50d569f-1839-4dc3-a5ba-9e1631e8994e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.350951 Aug 24 05:47:29.440664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 129/277] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:29 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:29.465887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.466605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.467105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.467884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.468410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.468903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.640061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-66f5bd0f-80c1-4c1a-a22e-abe6fbbed980 req-09784c3f-98ae-4118-802a-88d601b969bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbb21ff-3bc9-429e-b02e-1e141737d527", "tag": "4847b987-125b-407f-8502-11efd6617ff1"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:29.655937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-66f5bd0f-80c1-4c1a-a22e-abe6fbbed980 req-09784c3f-98ae-4118-802a-88d601b969bd service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:29.657199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-66f5bd0f-80c1-4c1a-a22e-abe6fbbed980 req-09784c3f-98ae-4118-802a-88d601b969bd service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:29.657966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-66f5bd0f-80c1-4c1a-a22e-abe6fbbed980 req-09784c3f-98ae-4118-802a-88d601b969bd service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:29.668382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:29.671325 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-66f5bd0f-80c1-4c1a-a22e-abe6fbbed980 req-09784c3f-98ae-4118-802a-88d601b969bd service nova] Creating event network-changed:4847b987-125b-407f-8502-11efd6617ff1 for instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 on hv-cinder-85426 Aug 24 05:47:29.678192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0db9a228-a201-418c-afe8-5b152e179719 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.244942 Aug 24 05:47:29.678731 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 149/278] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:29 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:29.685677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-66f5bd0f-80c1-4c1a-a22e-abe6fbbed980 req-09784c3f-98ae-4118-802a-88d601b969bd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052306 Aug 24 05:47:29.686701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 130/279] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:47:30.460681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:30.461341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:30.469656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:30.470224 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:30.470846 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:30.471460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:30.472204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:30.472600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:30.624086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:30.635274 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4399cca6-6302-4ff9-b7b7-a2b0b9d963b7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.176903 Aug 24 05:47:30.644416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 150/280] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:30 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:30.700517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:30.701238 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:30.708932 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:30.709721 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:30.710329 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:30.711316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:30.712064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:30.712647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:30.937334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:30.950603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6bee253d-04fd-4ae7-a875-18ebcb9e0d82 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.255006 Aug 24 05:47:30.951204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 131/281] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:30 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:31.655968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:31.656902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:31.663941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:31.664666 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:31.665297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:31.666388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:31.667279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:31.668456 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:31.840842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:31.849222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-eea71fb7-9e9e-4a10-98c3-b3075c166647 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.198192 Aug 24 05:47:31.862161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 151/282] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:31 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:31.971464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:31.972612 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:31.979578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:31.980604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:31.981150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:31.982399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:31.983036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:31.983930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:32.155349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:32.165552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7fc8ac4b-113e-435a-9bcd-41d062c3b324 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.198207 Aug 24 05:47:32.166441 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 132/283] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:31 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:32.875200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:32.875744 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:32.881752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:32.882232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:32.882669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:32.883378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:32.883833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:32.884255 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:33.027763 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:33.035423 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7eda71ae-84cb-4440-a82e-8b5164a9c45e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.164716 Aug 24 05:47:33.035997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 152/284] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:32 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:33.186393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:33.187011 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:33.192712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:33.193505 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=8 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:33.195981 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:33.196528 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:33.197046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:33.198025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:33.198490 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:33.199451 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:33.220516 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:33.393259 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:33.406090 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-098d385f-4e79-4f8a-bc38-ad9af0db82db tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.223470 Aug 24 05:47:33.406675 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 133/285] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:33 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:34.060926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:34.063095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:34.086168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:34.097914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:34.098474 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:34.107727 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:34.108595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:34.108983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:34.344111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:34.362923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-46467172-856e-454b-b125-6e15f461e315 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.309184 Aug 24 05:47:34.363672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 153/286] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:34 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:34.434454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:34.434913 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:34.443450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:34.445294 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:34.448163 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:34.450969 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:34.453691 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:34.456249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:34.654345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:34.662705 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-07973850-2f09-41bf-bd07-92b96c905c89 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.236895 Aug 24 05:47:34.673693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 134/287] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:34 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:35.385824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:35.387939 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:35.396957 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:35.397942 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:35.398763 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:35.400256 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:35.401154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:35.402521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:35.672298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:35.684318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-167740a0-7c52-40ae-9184-e2ca212f9dc6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.301780 Aug 24 05:47:35.684629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:35.685888 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 154/288] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:35 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:35.686229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:35.693650 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:35.702619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:35.703317 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:35.704382 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:35.706913 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:35.707351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:35.766279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-09f07fed-98c1-4748-b842-b9d9cb14efab req-4102f463-1e1c-4477-ac6e-16cb07cd3487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbb21ff-3bc9-429e-b02e-1e141737d527", "name": "network-vif-plugged", "status": "completed", "tag": "4847b987-125b-407f-8502-11efd6617ff1"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:35.779928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-09f07fed-98c1-4748-b842-b9d9cb14efab req-4102f463-1e1c-4477-ac6e-16cb07cd3487 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:35.780805 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-09f07fed-98c1-4748-b842-b9d9cb14efab req-4102f463-1e1c-4477-ac6e-16cb07cd3487 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:35.781480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-09f07fed-98c1-4748-b842-b9d9cb14efab req-4102f463-1e1c-4477-ac6e-16cb07cd3487 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:35.800160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-09f07fed-98c1-4748-b842-b9d9cb14efab req-4102f463-1e1c-4477-ac6e-16cb07cd3487 service nova] Creating event network-vif-plugged:4847b987-125b-407f-8502-11efd6617ff1 for instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 on hv-cinder-85426 Aug 24 05:47:35.806866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-09f07fed-98c1-4748-b842-b9d9cb14efab req-4102f463-1e1c-4477-ac6e-16cb07cd3487 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046056 Aug 24 05:47:35.808021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 155/289] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:47:35.911055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:35.919644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-af26f5f9-c006-454c-9e7c-469d10e4d1bc tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.239504 Aug 24 05:47:35.920573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 135/290] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:35 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:36.708968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:36.709693 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:36.715702 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:36.716173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:36.716601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:36.717281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:36.717765 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:36.718187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:36.846568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:36.854873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d38b3a9e-d97a-4530-93c5-32552fa98b96 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1521 microversion: 2.1 time: 0.150120 Aug 24 05:47:36.855450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 156/291] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:36 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:36.946763 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:36.947298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:36.954017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:36.954923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:36.955166 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:36.956183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:36.956672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:36.957093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:37.092728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:37.101032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d68b724e-d425-4e1c-a9b7-f3b3dc7b590c tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.158341 Aug 24 05:47:37.101747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 136/292] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:36 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:37.876376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:37.876991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:37.882941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:37.883420 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:37.883849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:37.884531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:37.884976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:37.885395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:38.021735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:38.029771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8138146d-dfce-4d69-a8ff-0805f3fd366d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1501 microversion: 2.1 time: 0.157988 Aug 24 05:47:38.030345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 157/293] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:37 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:38.050003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:38.050615 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:38.056878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:38.057354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:38.057824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:38.058508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:38.058958 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:38.059378 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:38.123816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:38.124417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:38.130262 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:38.130954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:38.131539 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:38.132250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:38.132695 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:38.133107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:38.200205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:38.208459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-457fa72e-d835-4325-bf6d-7eada9314165 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1516 microversion: 2.1 time: 0.162138 Aug 24 05:47:38.209168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 137/294] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:38 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:38.421732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:38.438413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bf693fee-4cf2-4deb-86d9-d7d100b8f7b9 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1314 microversion: 2.1 time: 0.319021 Aug 24 05:47:38.449653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 158/295] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:38 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:39.459422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:39.460027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:39.466753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.467233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.467661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.468414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.468863 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.469280 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.642732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:39.645648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:39.652065 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.653283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.653743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.654730 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.655192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.655617 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.680927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:39.689826 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lazy-loading 'flavor' on Instance uuid 698069e6-1a88-41db-9ac7-3a8a9dad417b {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:39.822045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a5fe4449-8a6f-4340-a695-8d964cad1df8 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b/action" status: 200 len: 32 microversion: 2.1 time: 0.183254 Aug 24 05:47:39.822928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 159/296] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:47:39 2022] POST /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 05:47:39.848761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:39.849531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:39.869774 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.870276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.870747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.872028 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:39.872481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:39.872903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:39.921376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:39.930725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-17d89789-7ad4-41da-b87e-9bda76754542 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1497 microversion: 2.1 time: 0.475109 Aug 24 05:47:39.936122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 138/297] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:39 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1497 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:40.044865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:40.055804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4e73bccb-a81d-4eb3-98d4-52f50d248935 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.210829 Aug 24 05:47:40.070291 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 160/298] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:39 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:40.621326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:40.621949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:40.629040 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:40.629527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:40.630001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:40.630702 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:40.631158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:40.631579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:40.660079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:47:40.735081 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0769ec00-a3c8-45a0-a13b-8ad34c8b3ba7 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 204 len: 0 microversion: 2.1 time: 0.121177 Aug 24 05:47:40.735669 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 139/299] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:47:40 2022] DELETE /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:47:40.744625 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:40.745397 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:40.752010 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:40.752494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:40.752925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:40.753657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:40.754116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:40.754530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:40.910364 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:40.922165 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-44db9cab-557c-42ab-9d46-76e0debb9ab8 tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1503 microversion: 2.1 time: 0.181981 Aug 24 05:47:40.922737 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 161/300] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:40 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:41.078627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:41.079413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:41.085700 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:41.086369 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:41.086865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:41.087559 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:41.088073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:41.088627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:41.240191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:41.248441 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c3cb2fb8-1ce2-45c6-9f65-96154c9956ec tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.174042 Aug 24 05:47:41.249014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 140/301] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:41 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:41.942966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:41.943704 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:41.949357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:41.949870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:41.950304 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:41.950991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:41.951595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:41.952152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:42.083079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:42.091164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-32034eda-98dd-4f64-8968-63e7fed2b74f tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1503 microversion: 2.1 time: 0.152197 Aug 24 05:47:42.091725 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 162/302] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:41 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:42.270174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:42.270703 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:42.277093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:42.277588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:42.278035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:42.279350 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:42.279867 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:42.280226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:42.406347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:42.413899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c2470893-5408-4a87-88cd-55a19e891539 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.147724 Aug 24 05:47:42.414476 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 141/303] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:42 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:43.112667 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:43.113313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:43.119698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:43.120179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:43.120611 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:43.121300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:43.121779 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:43.122201 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:43.254803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a621860d8fcb4327820ce6b802e6a725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82f6c80e9245427aad8acd3c8bd5efbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:43.262795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-91a8ec5a-403c-43d8-ade5-6523d5702ead tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 200 len: 1503 microversion: 2.1 time: 0.154483 Aug 24 05:47:43.263988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 163/304] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:43 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:43.372043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-202ac99b-f529-4e2e-bc66-078a654b665d req-a6993e51-f94a-4952-bf7c-52180843260e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbb21ff-3bc9-429e-b02e-1e141737d527", "name": "network-vif-deleted", "tag": "4847b987-125b-407f-8502-11efd6617ff1"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:43.384497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-202ac99b-f529-4e2e-bc66-078a654b665d req-a6993e51-f94a-4952-bf7c-52180843260e service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:43.384967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-202ac99b-f529-4e2e-bc66-078a654b665d req-a6993e51-f94a-4952-bf7c-52180843260e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:43.385390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-202ac99b-f529-4e2e-bc66-078a654b665d req-a6993e51-f94a-4952-bf7c-52180843260e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:43.398291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-202ac99b-f529-4e2e-bc66-078a654b665d req-a6993e51-f94a-4952-bf7c-52180843260e service nova] Creating event network-vif-deleted:4847b987-125b-407f-8502-11efd6617ff1 for instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 on hv-cinder-85426 Aug 24 05:47:43.402643 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-202ac99b-f529-4e2e-bc66-078a654b665d req-a6993e51-f94a-4952-bf7c-52180843260e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034736 Aug 24 05:47:43.403260 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 142/305] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:47:43.435809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:43.436421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:43.442431 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:43.442915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:43.443346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:43.444045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:43.444494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:43.444915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:43.586125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:43.598021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cd415b90-743f-47bd-bc86-864e3767b197 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.166256 Aug 24 05:47:43.598952 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 164/306] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:43 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:44.285487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:44.286229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] [instance: 8dbb21ff-3bc9-429e-b02e-1e141737d527] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:44.292499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:44.293007 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:44.293438 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:44.294165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:44.294610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:44.295028 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:44.308027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] HTTP exception thrown: Instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 could not be found. Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Request method failure captured: Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 HTTP/1.1 Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbtHsTxno0uZBp27tmN3Ws1iukVBgM9kscA6qoq76F-DM8SirwZqUUW-eIpmSkWUa2-C2Z3n2-RjkOZKKMH6auMHwheDcY3dabQQjGRV8zHZnsBKYg7BkphCiJp2dxNn9CAxigAqESFZbRpgohUQ2vP5nBdI90KvfMX02dW7RubMpLs Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 82f6c80e9245427aad8acd3c8bd5efbc Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-VolumesActionsTest-319305743 Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:47:44.310123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/82f6c80e9245427aad8acd3c8bd5efbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-VolumesActionsTest-319305743 Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 82f6c80e9245427aad8acd3c8bd5efbc Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-VolumesActionsTest-319305743 Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-VolumesActionsTest-319305743-project Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: a621860d8fcb4327820ce6b802e6a725 Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-VolumesActionsTest-319305743-project Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 could not be found. Aug 24 05:47:44.311276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '8dbb21ff-3bc9-429e-b02e-1e141737d527'} Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 could not be found. Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:47:44.311923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 could not be found. Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 could not be found. Aug 24 05:47:44.313156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:47:44.314445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] Returning 404 to user: Instance 8dbb21ff-3bc9-429e-b02e-1e141737d527 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:47:44.314445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b83aecfd-24a3-4837-9ffa-7b9afd20914b tempest-VolumesActionsTest-319305743 tempest-VolumesActionsTest-319305743-project] 10.222.0.73 "GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527" status: 404 len: 111 microversion: 2.1 time: 0.030514 Aug 24 05:47:44.314445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 143/307] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:44 2022] GET /compute/v2.1/servers/8dbb21ff-3bc9-429e-b02e-1e141737d527 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:47:44.621986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:44.623390 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:44.629821 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:44.630448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:44.630888 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:44.631581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:44.632033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:44.632454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:44.784694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:44.792671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0872acdb-edf3-4e61-8280-6e66279f195b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.174967 Aug 24 05:47:44.793403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 165/308] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:44 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:45.814633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:45.815255 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:45.821788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:45.822268 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:45.822699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:45.823383 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:45.823831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:45.824251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:45.955441 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:45.963011 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f54d833a-4035-438e-9910-b5326fe9c283 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.152200 Aug 24 05:47:45.963575 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 144/309] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:45 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:46.861210 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:46.861772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:46.867667 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.868143 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.868576 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:46.869259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.869730 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.870150 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:46.894541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dfac1326-f094-4d38-a98b-8b7fd3744579 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/ips" status: 200 len: 152 microversion: 2.20 time: 0.037468 Aug 24 05:47:46.895113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 166/310] 10.222.0.73 () {60 vars in 1289 bytes} [Wed Aug 24 05:47:46 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:47:46.983583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:46.984204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:46.990680 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.991158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.991598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:46.992295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:46.992757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:46.993183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:47.143158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:47.151131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-cce3ac8d-4cfa-475c-892c-6994c67c7529 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.171773 Aug 24 05:47:47.151733 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 145/311] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:46 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:47.644624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:47.645118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:47.651189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:47.651669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:47.652105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:47.652790 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:47.653242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:47.653695 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:47.677313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7d0449a3-7dfd-4176-a256-1b44b0ce655b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/ips" status: 200 len: 150 microversion: 2.1 time: 0.036524 Aug 24 05:47:47.677922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 167/312] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:47:47 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:48.171927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:48.172549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:48.174967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:48.179875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:48.180377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:48.181171 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:48.182008 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:48.182462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:48.182887 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:48.324879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:48.333135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c54015b6-5136-4d28-9d99-a935def587b4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.164983 Aug 24 05:47:48.333742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 146/313] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:48 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:49.355895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:49.356505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:49.359447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:49.364759 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:49.365245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:49.365714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:49.366413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:49.366868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:49.367293 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:49.495954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:49.503777 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fa5477f8-f945-4809-9925-be28b2a7e151 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.152043 Aug 24 05:47:49.504334 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 168/314] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:49 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:50.530533 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:50.531341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:50.537607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:50.538095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:50.538520 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:50.539213 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:50.539654 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:50.540068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:50.679195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:50.687500 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b56909f3-05b0-4198-9bd6-63b27d5a16ea tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.160221 Aug 24 05:47:50.688472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 147/315] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:50 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:51.158566 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "915acc62-8e95-4a95-bd44-c6508560b165"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:51.161330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:51.168483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.169074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.169861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.170682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.171691 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.172255 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.207642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:47:51.208580 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:51.215919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.217321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.218805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.221548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.222131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.222644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.251663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lazy-loading 'flavor' on Instance uuid 48d5dce2-87d9-41e2-87bd-e25ffdab7014 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:47:51.345201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:51.598190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7ed9c6c3-97ae-45a0-98f6-a9f9666a2a1c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443506 Aug 24 05:47:51.598931 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 169/316] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:47:51 2022] POST /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:47:51.709365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:51.710103 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:51.716921 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.717396 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.717854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.719028 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:51.719473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:51.719890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:51.855300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:51.864408 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-60a6df2f-1c4f-4c03-b386-007f51614f10 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.159681 Aug 24 05:47:51.865699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 170/317] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:51 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:52.886871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:52.887537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:52.894697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:52.895248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:52.895900 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:52.896586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:52.897152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:52.897452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:53.037266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:53.047956 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3238c395-292d-42e8-9f52-3034ee179cf7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.164626 Aug 24 05:47:53.048676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 171/318] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:52 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:54.072200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:54.072858 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:54.080653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:54.081258 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:54.082017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:54.082848 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:54.083541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:54.084176 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:54.232467 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:54.241200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fbafa791-5f4e-4051-a235-2b72c2b6bf88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.172883 Aug 24 05:47:54.241824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 172/319] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:54 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:55.290813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:55.292960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:55.300185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:55.300719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:55.301275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:55.302071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:55.302680 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:55.303303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:55.321522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:47:55.446529 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:55.454190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c1a9fc67-8edd-40f1-9eb5-03140bf1c665 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.170125 Aug 24 05:47:55.454896 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 173/320] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:55 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:56.474458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:56.475165 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:56.481663 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:56.482223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:56.482724 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:56.483664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:56.484113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:56.484655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:56.627881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:56.635701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5546a578-01bf-43b3-a097-5a6a8dfed6af tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.165179 Aug 24 05:47:56.642289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 174/321] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:56 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:47:57.656378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:57.657090 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:57.673370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:57.674547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:57.675196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:57.676261 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:57.676770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:57.677342 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:57.848803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:57.856434 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1b65e660-79c7-4b11-933b-51d5e24fdad1 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.204664 Aug 24 05:47:57.857253 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 175/322] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:57 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:47:58.878277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:47:58.879589 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:47:58.886202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:58.886692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:58.887137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:58.887833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:47:58.888284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:47:58.888708 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:47:59.024548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:47:59.032623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d2ff89f6-c4eb-41c9-821a-ca306594a2bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.158666 Aug 24 05:47:59.046147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 176/323] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:47:58 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:00.056049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:00.057594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:00.065540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:00.066655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:00.067251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:00.068155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:00.069072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:00.069742 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:00.235928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:00.245491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-02589d99-6d44-4b28-bc0c-d9acf5f3ce9a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.193668 Aug 24 05:48:00.246875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 177/324] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:00 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:01.215511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=5 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:01.274137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:01.275656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:01.283091 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:01.283675 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:01.284482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:01.285384 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:01.286023 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:01.286614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:01.432302 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:01.469930 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:01.479168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-35fb3c6f-4505-4a85-84e8-0bb4c3350f61 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.216133 Aug 24 05:48:01.479724 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 178/325] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:01 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:02.507892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:02.509101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:02.518339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.519614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.520313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:02.522311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:02.522772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:02.523261 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:02.684676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:02.693400 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e52b885f-40c4-4a2f-b865-ac3051d8ff79 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.197387 Aug 24 05:48:02.694343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 179/326] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:02 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:03.717895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:03.718676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:03.726457 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.728238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.728790 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.729628 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.730212 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.730907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.850911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-10a9eb6b-7a76-4448-99b8-92b0889b2ee9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/action" status: 202 len: 0 microversion: 2.20 time: 12.649243 Aug 24 05:48:03.852470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 148/327] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 05:47:51 2022] POST /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/action => generated 0 bytes in 12653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:48:03.866406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:03.868945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:03.887068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.888720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.889487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.890414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:03.891707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:03.891707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:03.981168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:03.993944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c848f1e1-2f34-400f-85af-686dd68236f4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.280394 Aug 24 05:48:04.007238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 180/328] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:03 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:04.214645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:04.223788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:04.225305 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:04.226507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-cff78017-815b-4fa0-a941-83da88f46d6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.369480 Aug 24 05:48:04.227064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 149/329] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:03 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:04.561462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f2679c06-f4c8-4477-991b-283872d86c5c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: .version_select at 0x7fa91c4adc10>, body: {"keypair": {"name": "tempest-keypair-1415609316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERVeQ/YohQWadmsudO90zNvcFwoyzpQpT8PS9igEAZfzuhgDwJXC1JORCXUmiO2KUUE8o07hAH3ktuJf/+wVm7uEopHbon0BBj2N2KA/jeAEi/pGf+44Ldee0ZlJmqeGg=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:04.576308 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-f2679c06-f4c8-4477-991b-283872d86c5c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:48:04.580097 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-f2679c06-f4c8-4477-991b-283872d86c5c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:48:04.606319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f2679c06-f4c8-4477-991b-283872d86c5c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048108 Aug 24 05:48:04.607179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 181/330] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:48:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:05.020952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:05.021593 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:05.034592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.035213 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.035894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.037542 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.038221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.039131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.251473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:05.252970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:05.260576 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.261677 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.262358 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.263166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:05.263722 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:05.264241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:05.317851 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:05.339718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7463f083-17dc-4251-ad88-b5a3d9e285ff tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.323109 Aug 24 05:48:05.354156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 150/331] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:05 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:05.438253 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:05.450136 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:05.452794 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:05.454752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0ca5362f-77ee-41ad-9cf2-43edf49ef58d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.208112 Aug 24 05:48:05.457127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 182/332] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:05 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:06.167014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-673289243", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7299e068-1622-4d4b-9084-04ba950ea9f9"}], "security_groups": [{"name": "tempest-securitygroup--712322023"}], "key_name": "tempest-keypair-1415609316", "user_data": "}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:06.308507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] validate_networks() for [('7299e068-1622-4d4b-9084-04ba950ea9f9', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:48:06.372715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:06.374346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:06.385033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.385557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.386372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.387672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.388532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.389158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.651142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:06.659993 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-467395f9-32f0-4614-b40d-d8300ddc61b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.294879 Aug 24 05:48:06.660683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 183/333] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:06 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:06.673501 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:06.673501 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:06.673501 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.674793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.674793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.675520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.675520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.675943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.851483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:06.862783 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:06.865392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:06.866602 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3af65f19-5f8f-4aa0-8348-b8715ba446a9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.205003 Aug 24 05:48:06.867486 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 184/334] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:06 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:06.892813 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:48:06.893459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:48:06.894838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:48:06.895377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:48:06.895938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:48:06.904885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.905650 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.906325 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.907244 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:06.907892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:06.908371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:06.926127 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:48:06.930435 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:48:06.941485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:48:06.943787 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:48:06.990667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-433fab83-03c7-4f21-9bab-bfa2b427cc68 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.828273 Aug 24 05:48:06.991517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 151/335] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:48:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:48:07.002084 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d5dc2ad8-9d6e-4600-be4f-5bbebda2c297 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:07.002727 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d5dc2ad8-9d6e-4600-be4f-5bbebda2c297 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:07.054935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d5dc2ad8-9d6e-4600-be4f-5bbebda2c297 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:07.061612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d5dc2ad8-9d6e-4600-be4f-5bbebda2c297 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1241 microversion: 2.1 time: 0.063280 Aug 24 05:48:07.062185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 185/336] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:06 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:07.682219 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:07.682944 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:07.692896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.693393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.693857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.696301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.697200 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.697993 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.890635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:07.891419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:07.896151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:07.899873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.900370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.901036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.902101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:07.902941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:07.903527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:07.905144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-10a0bb27-7e14-49fa-9f7f-b3176c57266b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.227728 Aug 24 05:48:07.906292 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 152/337] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:07 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:08.058624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:08.067936 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:08.070898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:08.072271 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-074069fa-ddda-4698-9984-c5e262258cb8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.185957 Aug 24 05:48:08.073031 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 186/338] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:07 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:08.086887 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:08.087528 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:08.093434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:08.093944 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:08.094369 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:08.095073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:08.095517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:08.095931 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:08.157665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:08.165752 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-06ba201a-12f3-49e9-9d54-576e955065cc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1293 microversion: 2.1 time: 0.082822 Aug 24 05:48:08.166396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 153/339] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:08 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:08.929409 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:08.930273 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:08.940962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:08.941591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:08.942331 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:08.943198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:08.943891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:08.944472 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.098245 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:09.099039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.114879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.116013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.118117 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.119081 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.120695 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.121233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.137433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:09.147741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fd697a0f-96c6-430e-b930-44b0f1f83a8d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1502 microversion: 2.1 time: 0.224198 Aug 24 05:48:09.164460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 187/340] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:08 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:09.170099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b88d0941-8a40-4266-a6ff-00e4dce51f84"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:09.172981 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.180399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.181144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.181770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.182619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.183242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.183837 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.229056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] HTTP exception thrown: Cannot 'attach_volume' instance 698069e6-1a88-41db-9ac7-3a8a9dad417b while it is in vm_state rescued Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Request method failure captured: Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: POST /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b/os-volume_attachments HTTP/1.1 Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 74 Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsdP7Q-t8JRnuv4BFU0EFKbt_HtrMXv561NX0UrC6t-iBOAcNLf5m4dhrd4VtGj3WNb3JuuyIrLxJC09Afr6RfY3LKXcmcuolAwf26AfOMVx8jQxsuDTZYMf7rtd4_ZRgZ8V6YAidgJ7qvXt3Re-KaPSji-ET6Pzsg3lCvUveQavBk Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:48:09.230778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3726a58288d9455b97e041a2e92f8850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 3d8467cc62d948038690af1fdf5bb96a Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {"volumeAttachment": {"volumeId": "b88d0941-8a40-4266-a6ff-00e4dce51f84"}} Aug 24 05:48:09.232277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Cannot 'attach_volume' instance 698069e6-1a88-41db-9ac7-3a8a9dad417b while it is in vm_state rescued Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'server_id': '698069e6-1a88-41db-9ac7-3a8a9dad417b', 'body': {'volumeAttachment': {'volumeId': 'b88d0941-8a40-4266-a6ff-00e4dce51f84'}}} Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 698069e6-1a88-41db-9ac7-3a8a9dad417b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:48:09.233162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 698069e6-1a88-41db-9ac7-3a8a9dad417b while it is in vm_state rescued Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:48:09.234772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:48:09.236145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:48:09.236145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:48:09.236145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 698069e6-1a88-41db-9ac7-3a8a9dad417b while it is in vm_state rescued Aug 24 05:48:09.236145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:48:09.237208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Returning 409 to user: Cannot 'attach_volume' instance 698069e6-1a88-41db-9ac7-3a8a9dad417b while it is in vm_state rescued {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:48:09.238901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2c8d07fb-10fb-4de6-b7bc-599706b3312a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.073028 Aug 24 05:48:09.243285 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 188/341] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:48:09 2022] POST /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:48:09.251361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:09.257736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.268185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.271164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.271637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.272353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.272802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.277940 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.357146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:09.370607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7f9da88a-3f5a-4aab-beb4-d770802b84c7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1299 microversion: 2.1 time: 0.125957 Aug 24 05:48:09.371167 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 189/342] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:09 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:09.376367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:09.377083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.389913 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.390601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.391233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.391357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:09.392203 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.392999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.393655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.417123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:09.421768 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:09.426085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c9e353df-7239-493d-8692-911c11c988f5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.333625 Aug 24 05:48:09.429308 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 154/343] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:09 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:09.512568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-972b042f-beaa-4f83-bd23-5d22c2d5b394 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b/action" status: 202 len: 0 microversion: 2.1 time: 0.139640 Aug 24 05:48:09.514555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 190/344] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:48:09 2022] POST /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:48:09.524906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:09.525832 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:09.558922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.559550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.560002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:09.560743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:09.561202 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:09.561654 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.089299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:10.107774 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0ca8bba2-b5e4-42b6-9969-08e12b6fed9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1510 microversion: 2.1 time: 0.588282 Aug 24 05:48:10.113177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 155/345] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:09 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1510 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:10.393305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:10.394093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:10.407684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.408133 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.408580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.410065 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.410279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.411387 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.441947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:10.455226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:10.456020 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:10.468641 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.469195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.469781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.470544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:10.471073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:10.475577 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:10.604558 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:10.618051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-df3b90f1-1076-4fa3-aa5a-1d29552cc02a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.228988 Aug 24 05:48:10.619338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 191/346] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:10 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:11.058841 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.067985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.075249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.076647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c4969c8d-a432-4a1f-a593-6ad3d1739bc9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.625505 Aug 24 05:48:11.096448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 156/347] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:10 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:11.136790 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:11.138542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:11.174494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.178313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.178890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.180138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.180706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.184423 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.517124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.541197 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-03dc0fee-a462-4427-b0b1-7a65870bb911 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1510 microversion: 2.1 time: 0.410506 Aug 24 05:48:11.554718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 192/348] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:11 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:11.639806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:11.640415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:11.651149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.654144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.654549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.656117 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:11.656890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:11.657320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:11.971268 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:11.980093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7c132b69-05e7-4d28-99fe-f43f36a8f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.344094 Aug 24 05:48:11.980680 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 157/349] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:11 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:12.071264 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-e36c8ab7-f61f-4ac4-a44c-71fa96274499 req-ea0fb06f-a2f9-4edb-acb1-10accb63d3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfde071-16a2-4288-aec1-6d38bb343db6", "tag": "0ca758be-f754-4b9b-998e-751693bc9390"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:12.084424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e36c8ab7-f61f-4ac4-a44c-71fa96274499 req-ea0fb06f-a2f9-4edb-acb1-10accb63d3fd service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.085924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e36c8ab7-f61f-4ac4-a44c-71fa96274499 req-ea0fb06f-a2f9-4edb-acb1-10accb63d3fd service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.087197 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e36c8ab7-f61f-4ac4-a44c-71fa96274499 req-ea0fb06f-a2f9-4edb-acb1-10accb63d3fd service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.107678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:12.108737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:12.123140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.123830 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.124376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.126307 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.128337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-e36c8ab7-f61f-4ac4-a44c-71fa96274499 req-ea0fb06f-a2f9-4edb-acb1-10accb63d3fd service nova] Creating event network-changed:0ca758be-f754-4b9b-998e-751693bc9390 for instance 2bfde071-16a2-4288-aec1-6d38bb343db6 on hv-cinder-85426 Aug 24 05:48:12.132423 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.136581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-e36c8ab7-f61f-4ac4-a44c-71fa96274499 req-ea0fb06f-a2f9-4edb-acb1-10accb63d3fd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068663 Aug 24 05:48:12.136711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.138372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 193/350] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:48:12.420155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:12.430141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:12.432513 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:12.433984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ad41ec4b-167e-4400-b71e-a5fd8812f187 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.332653 Aug 24 05:48:12.434538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 158/351] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:12 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:12.567961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:12.569490 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:12.577146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.578022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.578614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.579548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:12.580282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:12.581121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:12.793538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:12.811655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7bb62533-2f2c-4047-9c00-2c10380c84d9 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1510 microversion: 2.1 time: 0.248560 Aug 24 05:48:12.818610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 194/352] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:12 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:13.001246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:13.002004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:13.013516 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.014507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.014957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.015703 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.017769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.032129 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.345402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:13.359168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1bf4f595-960e-4ec6-95ec-156797241d8a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.361166 Aug 24 05:48:13.360467 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 159/353] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:12 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:13.472702 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:13.473320 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:13.484201 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.484792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.485383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.486436 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.487076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.488589 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.698561 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:13.708656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:13.710375 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:13.711613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-12bc0595-f63c-435c-b783-9eaa49a78f3b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.245433 Aug 24 05:48:13.712252 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 195/354] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:13 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:13.842274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:13.843134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:13.850389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.851115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.851733 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.852658 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:13.853101 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:13.853609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:13.980001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:13.987824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4f9ca109-b552-42be-bb80-e9a269c73abc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1516 microversion: 2.1 time: 0.149414 Aug 24 05:48:13.988392 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 160/355] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:13 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:14.380592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:14.381206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:14.387518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.387986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.388406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.389079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.389520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.389959 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.520473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:14.527970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1b9111ba-52ca-4629-9321-f35d704c3ab6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.151806 Aug 24 05:48:14.528528 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 196/356] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:14 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:14.735196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:14.735813 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:14.742886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.743362 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.743795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.744483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:14.744931 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:14.745355 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:14.876451 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:14.884899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:14.886456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:14.887609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-63094e6e-7f6a-453f-8622-78a721027db4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.156613 Aug 24 05:48:14.888168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 161/357] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:14 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:15.548365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:15.548901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:15.555460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.555935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.556363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.557043 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.557492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.557947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.684438 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:15.692561 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-68a68e01-d0ee-40a0-82c6-6d262aebbd4e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.148066 Aug 24 05:48:15.693124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 197/358] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:15 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:15.910545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:15.911142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:15.917502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.918017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.918438 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:15.919113 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:15.919570 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:15.919965 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.045747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:16.055227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:16.056771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:16.057950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a0b92d14-c69e-4901-a1cc-b9111ffe1ac2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.151287 Aug 24 05:48:16.058509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 162/359] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:15 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:16.713345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:16.713991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:16.720298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:16.720772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:16.721204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.722649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:16.723099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:16.723520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:16.907309 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:16.916564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-be6c8338-8ec6-43c4-9c69-69342f6e1f23 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.206717 Aug 24 05:48:16.917817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 198/360] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:16 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:17.082415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:17.083318 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:17.091642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:17.092746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=6 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:17.095579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.096323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.097547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:17.098511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.098973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.099393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:17.287326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:17.298188 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:17.301755 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:17.303176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c0c778f1-66fb-4e1a-8fdc-bb080808a2db tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.224826 Aug 24 05:48:17.303726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 163/361] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:17 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:17.466997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=6 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:17.471692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9f62a4a3-b717-4839-84c6-15cd725a963f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'create', calling method: .version_select at 0x7fa91c4ad280>, body: {"keypair": {"name": "tempest-keypair-1324129782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfb+vy0M59/O+l/cw65JcAPkWRrpZQVloKFtekpWFE3I9BGcCnFFt9xAW7mVZr3VpE/kjo9hG8KUrhB7gT9HSVFjB1mYyrHOPUf2nEpjE+dZDfUGQDEisvcRoFs7kDV7Q=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:17.489168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-9f62a4a3-b717-4839-84c6-15cd725a963f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for project 3726a58288d9455b97e041a2e92f8850. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:48:17.493834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-9f62a4a3-b717-4839-84c6-15cd725a963f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for user 3d8467cc62d948038690af1fdf5bb96a and project 3726a58288d9455b97e041a2e92f8850. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:48:17.522037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9f62a4a3-b717-4839-84c6-15cd725a963f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055721 Aug 24 05:48:17.522673 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 199/362] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:48:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:17.939542 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:17.941665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:17.951256 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1453098860", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "networks": [{"uuid": "0e5c96db-5fec-41fc-ba80-01fd385351d8"}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:17.962668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.965270 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.968364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:17.969212 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:17.970282 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:17.970752 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.022886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] validate_networks() for [('0e5c96db-5fec-41fc-ba80-01fd385351d8', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:48:18.193086 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:18.206566 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-37b6c5cd-7498-4fa9-80c5-319963e5f170 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.271023 Aug 24 05:48:18.207411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 164/363] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:17 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:18.331893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:18.332878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:18.353305 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.353927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.354357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.355067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.355515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.355939 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.513330 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:18.524938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:18.526576 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:18.527768 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-401bea80-4aad-4376-8729-8e4632bbc356 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.200751 Aug 24 05:48:18.541591 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 165/364] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:18 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:18.964764 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:48:18.965930 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:48:18.966715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:48:18.967435 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:48:18.968092 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:48:18.978533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.979240 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.979852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:18.980952 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:18.981587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:18.982286 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.007709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Getting quotas for project 87f7a45fce204c9c9c15fae64b26b61e. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:48:19.012820 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Getting quotas for user 8e9cefedd37f43e6bb64a270cde9f6b6 and project 87f7a45fce204c9c9c15fae64b26b61e. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:48:19.026070 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:48:19.028906 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:48:19.051905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:19.090638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5c327877-9ffd-42e4-9b22-42f02bde5ed4 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147335 Aug 24 05:48:19.092088 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 200/365] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:48:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:48:19.103613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5407f09f-b72f-463e-b8c7-ad30d4f6aba0 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:19.104471 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5407f09f-b72f-463e-b8c7-ad30d4f6aba0 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:19.196764 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5407f09f-b72f-463e-b8c7-ad30d4f6aba0 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.217426 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5407f09f-b72f-463e-b8c7-ad30d4f6aba0 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1219 microversion: 2.1 time: 0.117171 Aug 24 05:48:19.218892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 166/366] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:19 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:19.234095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:19.234635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:19.241354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.241884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.242390 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.243097 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.243543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.243966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.552538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:19.553191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:19.555972 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.560030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.561027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.561631 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.562481 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:19.563082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:19.563663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:19.564713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dca86e70-2c8e-419f-9d45-1629a3909f4c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.334799 Aug 24 05:48:19.569142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:19.575833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 201/367] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:19 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:19.703346 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.712722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.714272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:19.715450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fe25f18f-930a-4e5e-9e5c-5ec2e3f86d74 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.167355 Aug 24 05:48:19.716006 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 167/368] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:19 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:19.896711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-563770516", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62c4e1e9-8d68-4a3b-82b7-dbed6a218e84"}], "security_groups": [{"name": "tempest-securitygroup--2060705147"}], "key_name": "tempest-keypair-1324129782", "user_data": "}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:20.023910 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] validate_networks() for [('62c4e1e9-8d68-4a3b-82b7-dbed6a218e84', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:48:20.252417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:20.262527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:20.276258 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.277399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.277995 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.282388 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.286596 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.287279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.368122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.378930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-84253e0e-7086-423e-9643-17aab740ce81 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1271 microversion: 2.1 time: 0.143336 Aug 24 05:48:20.380288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 168/369] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:20 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:20.463461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:48:20.463917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:48:20.464406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:48:20.464834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:48:20.465239 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:48:20.473897 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.474370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.474794 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.475507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.475953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.476367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.495773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for project 3726a58288d9455b97e041a2e92f8850. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:48:20.499801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Getting quotas for user 3d8467cc62d948038690af1fdf5bb96a and project 3726a58288d9455b97e041a2e92f8850. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:48:20.513040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:48:20.515574 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:48:20.586973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:20.587973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:20.595452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-38282cc8-e144-4c97-981e-a9a0d0753db7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.703444 Aug 24 05:48:20.597113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 202/370] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:48:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:48:20.612915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2aa8c877-625c-4183-b8bf-9e8876c0153a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:20.613893 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2aa8c877-625c-4183-b8bf-9e8876c0153a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:20.615178 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.615876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.616529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.617511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.618019 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.618569 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.697200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2aa8c877-625c-4183-b8bf-9e8876c0153a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.705453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2aa8c877-625c-4183-b8bf-9e8876c0153a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1245 microversion: 2.1 time: 0.101042 Aug 24 05:48:20.706268 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 203/371] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:20 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:20.740810 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:20.741432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:20.750032 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.750486 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.750925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.755996 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:20.756473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:20.756994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:20.917261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.929914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-85130f75-1c86-46ea-9937-40a3e860df34 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.345532 Aug 24 05:48:20.930769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 169/372] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:20 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:20.964042 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.974079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.978946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:20.996275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c47536a3-bc07-4b1b-bcc3-84d39ad0a8bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.244801 Aug 24 05:48:21.010178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 204/373] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:20 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:21.403141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:21.403759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:21.411403 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.412237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.412876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.413847 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.414540 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.415177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.589749 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:21.597742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-12504501-0a9d-4432-a17b-9600990e8207 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.198957 Aug 24 05:48:21.598340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 170/374] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:21 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:21.726122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:21.727527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:21.739223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.739892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.740160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.740870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.741505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.742016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.817894 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:21.826639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-50a79400-bea8-4b53-8738-ca5b3e3c0b54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1297 microversion: 2.1 time: 0.104457 Aug 24 05:48:21.827275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 205/375] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:21 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:21.951563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:21.952346 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:21.958398 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.958880 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.959308 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:21.959998 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:21.960448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:21.960864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.023027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:22.023637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:22.029646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.030132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.030567 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.031263 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.031717 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.032140 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.165807 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:22.176232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-06163917-33cc-4ee5-92b5-99edfef8232e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.228693 Aug 24 05:48:22.176890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 171/376] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:21 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:22.194798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:22.203653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:22.205580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:22.207033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a81ec743-109e-4641-895e-a3794dfc66c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.188161 Aug 24 05:48:22.213599 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 206/377] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:22 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:22.488025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-3b286e47-5e5f-4640-9b86-c6ab380498b6 req-805471f9-bbdf-4282-aa8f-254e24289714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f", "tag": "c03ff667-2411-4f7e-bb83-efebc24e1067"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:22.506349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3b286e47-5e5f-4640-9b86-c6ab380498b6 req-805471f9-bbdf-4282-aa8f-254e24289714 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.506830 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3b286e47-5e5f-4640-9b86-c6ab380498b6 req-805471f9-bbdf-4282-aa8f-254e24289714 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.507256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3b286e47-5e5f-4640-9b86-c6ab380498b6 req-805471f9-bbdf-4282-aa8f-254e24289714 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.551501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-3b286e47-5e5f-4640-9b86-c6ab380498b6 req-805471f9-bbdf-4282-aa8f-254e24289714 service nova] Creating event network-changed:c03ff667-2411-4f7e-bb83-efebc24e1067 for instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f on hv-cinder-85426 Aug 24 05:48:22.557399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-3b286e47-5e5f-4640-9b86-c6ab380498b6 req-805471f9-bbdf-4282-aa8f-254e24289714 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074475 Aug 24 05:48:22.558885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 172/378] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:22.621208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:22.622212 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:22.631402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.631898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.632819 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.634168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.634624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.635229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.779374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:22.787596 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3cbb8334-331f-4e7b-bc15-3b3a8b6470fd tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.171365 Aug 24 05:48:22.788215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 207/379] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:22 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:22.850150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:22.850859 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:22.858245 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.859243 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.859933 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:22.860930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:22.861390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:22.861846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.022205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.031122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-37ed3088-cac7-4a36-a239-b2f1d6e8a78a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1303 microversion: 2.1 time: 0.186713 Aug 24 05:48:23.032029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 173/380] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:22 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1303 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:23.169296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-cf182efd-bf56-43e3-ba2a-2a86c1bd5146 req-8574777c-8a8b-4987-8ba1-baf6386d00e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfde071-16a2-4288-aec1-6d38bb343db6", "name": "network-vif-plugged", "status": "completed", "tag": "0ca758be-f754-4b9b-998e-751693bc9390"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:23.183258 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-cf182efd-bf56-43e3-ba2a-2a86c1bd5146 req-8574777c-8a8b-4987-8ba1-baf6386d00e1 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.183849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-cf182efd-bf56-43e3-ba2a-2a86c1bd5146 req-8574777c-8a8b-4987-8ba1-baf6386d00e1 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.184379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-cf182efd-bf56-43e3-ba2a-2a86c1bd5146 req-8574777c-8a8b-4987-8ba1-baf6386d00e1 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.201341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:23.202167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:23.218329 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.219684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-cf182efd-bf56-43e3-ba2a-2a86c1bd5146 req-8574777c-8a8b-4987-8ba1-baf6386d00e1 service nova] Creating event network-vif-plugged:0ca758be-f754-4b9b-998e-751693bc9390 for instance 2bfde071-16a2-4288-aec1-6d38bb343db6 on hv-cinder-85426 Aug 24 05:48:23.220172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.220722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.225753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.225753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.227165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.242438 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-cf182efd-bf56-43e3-ba2a-2a86c1bd5146 req-8574777c-8a8b-4987-8ba1-baf6386d00e1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078366 Aug 24 05:48:23.245786 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 208/381] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:23.265988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:23.266963 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:23.284711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.285395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.286025 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.286836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.287399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.288821 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.467391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.477950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.479506 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.480661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4e41a246-c5e9-4d98-b26e-57da7a7158a1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1744 microversion: 2.20 time: 0.233605 Aug 24 05:48:23.481226 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 209/382] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:23 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:23.808148 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:23.808740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:23.815901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.816457 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.817080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.817772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:23.818292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:23.818798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:23.943187 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:23.961888 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6c5653e8-b5d5-4ae4-93fb-c35510ef1688 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.765746 Aug 24 05:48:23.963077 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 174/383] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:23 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:24.048714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:24.056303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-73fc56e6-d88b-4180-b88b-eab2465de958 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.251785 Aug 24 05:48:24.057179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 210/384] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:23 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:24.070160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:24.070160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:24.091580 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.092092 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.093445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.094419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.103244 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.103716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.234549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:24.245421 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a749bcff-8913-4f19-9011-293256647412 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1303 microversion: 2.1 time: 0.193834 Aug 24 05:48:24.247334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 175/385] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:24 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:24.507776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:24.517377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:24.529479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.538193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.540644 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.541535 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:24.542271 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:24.545057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:24.735599 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:24.744856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:24.746391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:24.747593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-784ff81e-9aa9-4f64-86a5-2a117ca94165 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1744 microversion: 2.20 time: 0.246995 Aug 24 05:48:24.748699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 211/386] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:24 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1744 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:24.983153 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:24.984753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:25.008305 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.009321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.009975 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.011393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.012823 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.013480 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.077913 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:25.079082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:25.089351 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.094313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.094994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.098521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.100402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.101062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.320815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:25.328625 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:25.331812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-66b3f709-18c7-419a-abdd-97dcdd286447 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.257937 Aug 24 05:48:25.346365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 212/387] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:25 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:25.351410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:25.352239 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:25.364011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.364767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.365433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.366405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.367838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.368812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.392910 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:25.408662 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-31aeda03-29a7-4852-905f-9ab36a869541 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1366 microversion: 2.1 time: 0.429275 Aug 24 05:48:25.411173 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 176/388] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:24 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:25.424373 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-a9127014-804d-42ae-bda5-8706690f6fa6 req-7f5efe04-bf43-4e46-a2b5-6c15798dc90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d5dce2-87d9-41e2-87bd-e25ffdab7014", "name": "network-vif-plugged", "status": "completed", "tag": "837c49ba-3839-4640-af5d-797916aa3934"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:25.438829 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a9127014-804d-42ae-bda5-8706690f6fa6 req-7f5efe04-bf43-4e46-a2b5-6c15798dc90f service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.439668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a9127014-804d-42ae-bda5-8706690f6fa6 req-7f5efe04-bf43-4e46-a2b5-6c15798dc90f service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.441054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a9127014-804d-42ae-bda5-8706690f6fa6 req-7f5efe04-bf43-4e46-a2b5-6c15798dc90f service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.457316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-a9127014-804d-42ae-bda5-8706690f6fa6 req-7f5efe04-bf43-4e46-a2b5-6c15798dc90f service nova] Creating event network-vif-plugged:837c49ba-3839-4640-af5d-797916aa3934 for instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 on hv-cinder-85426 Aug 24 05:48:25.463825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-a9127014-804d-42ae-bda5-8706690f6fa6 req-7f5efe04-bf43-4e46-a2b5-6c15798dc90f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050497 Aug 24 05:48:25.464810 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 177/389] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:25.578401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:25.593479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6a4d0b26-fbeb-4151-9875-6aebdf7ce5b3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.245486 Aug 24 05:48:25.605776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 213/390] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:25 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:25.773409 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:25.774423 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:25.781920 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.782686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.783276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:25.784150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:25.784789 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:25.785216 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.109698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:26.123326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:26.125090 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:26.126541 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-03b5d3b6-458c-434b-bb86-479cf5ba6503 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1744 microversion: 2.20 time: 0.358510 Aug 24 05:48:26.127170 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 178/391] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:25 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1744 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:26.152276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-83f02be3-c74e-4b07-a27a-9b1716c1691d req-69ba6d43-2802-4dcd-b6a4-28b5f884438a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d74183-be9d-44b4-8b74-95591db6be75", "tag": "7a0a208c-567e-4aee-9e6e-fb5216b6b6fe"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:26.163800 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-83f02be3-c74e-4b07-a27a-9b1716c1691d req-69ba6d43-2802-4dcd-b6a4-28b5f884438a service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.164282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-83f02be3-c74e-4b07-a27a-9b1716c1691d req-69ba6d43-2802-4dcd-b6a4-28b5f884438a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.164710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-83f02be3-c74e-4b07-a27a-9b1716c1691d req-69ba6d43-2802-4dcd-b6a4-28b5f884438a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.176990 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-83f02be3-c74e-4b07-a27a-9b1716c1691d req-69ba6d43-2802-4dcd-b6a4-28b5f884438a service nova] Creating event network-changed:7a0a208c-567e-4aee-9e6e-fb5216b6b6fe for instance e9d74183-be9d-44b4-8b74-95591db6be75 on hv-cinder-85426 Aug 24 05:48:26.182381 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-83f02be3-c74e-4b07-a27a-9b1716c1691d req-69ba6d43-2802-4dcd-b6a4-28b5f884438a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033876 Aug 24 05:48:26.183621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 214/392] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:26.353300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:26.353992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:26.363848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.364341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.364778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.365487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.369122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.369609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.431822 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:26.432858 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:26.443336 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.444163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.444806 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.445788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.446503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.447138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.677184 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:26.690644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-60f77c47-020c-4e62-ba9c-9d19172ad83d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.341147 Aug 24 05:48:26.704732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 179/393] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:26 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:26.710059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:26.710812 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:26.717218 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.718059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.718744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.719680 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.720343 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.721086 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.734058 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:26.753122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-96b2d07c-aaf5-406b-bfd2-25bc863195cf tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1555 microversion: 2.1 time: 0.324076 Aug 24 05:48:26.759549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 215/394] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:26 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:26.774693 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:26.775511 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:26.783394 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.784629 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.785332 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.786313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:26.786954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:26.787756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:26.923456 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-51d87a6c-1161-4d06-907e-230fded5b860 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152612 Aug 24 05:48:26.931976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 216/395] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:48:26 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:27.051450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:27.064453 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-10e69bca-49bc-44fa-9b9a-5527143ef8a7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.358001 Aug 24 05:48:27.065592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 180/396] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:26 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:27.154049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:27.155648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:27.172344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.173245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.174128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.175136 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.177155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.179224 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.711573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:27.712893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:27.725085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.728419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.729057 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.729906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:27.730452 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:27.734379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:27.783089 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:27.792225 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:27.793767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:27.794951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-805da362-bcc4-44aa-aab6-3b57b4a02d46 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.648349 Aug 24 05:48:27.802917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 217/397] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:27 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:28.094122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:28.095704 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:28.114366 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.115264 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.115932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:28.118227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.119434 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.125825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:28.460965 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:28.485863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-12e932ba-c184-4345-81a9-8e033eb930bf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.391307 Aug 24 05:48:28.487772 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 218/398] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:28 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:28.828391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:28.838281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:28.849623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.850519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.851833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:28.854071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:28.857320 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:28.858712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:29.134442 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:29.152404 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a2d5f778-cf69-4ee3-8b43-a859388da2d7 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 1.444537 Aug 24 05:48:29.155598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 181/399] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:27 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:29.184474 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:29.194053 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:29.195646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:29.196844 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8c954059-386e-4b83-905e-575d45c621ae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.376859 Aug 24 05:48:29.201902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 219/400] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:28 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:29.510094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:29.510990 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:29.513216 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:29.524244 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:29.534504 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:29.540833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:29.542953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:29.543629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:29.544240 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.177530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:30.178870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:30.185887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.207998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.210586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.213847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.214544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.217854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.496732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=4 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:30.701691 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=18 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:30.753969 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:30.766678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-40c9cfa2-3888-4ae8-975b-44ee9b2fa77b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.593968 Aug 24 05:48:30.770260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 220/401] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:30 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:30.787563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:30.788610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:30.799975 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.802006 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.804075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.809464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:30.816337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.821714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.823278 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.830927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c38de8bf-aadb-4c91-8351-ce89b02cea54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 1.321757 Aug 24 05:48:30.834393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 182/402] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:29 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:30.850339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-c03a4496-a17c-4d3e-85bd-89e085319533 req-edd82db2-0f3b-48b3-bb8d-05eb73542e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f", "name": "network-vif-plugged", "status": "completed", "tag": "c03ff667-2411-4f7e-bb83-efebc24e1067"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:30.884446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-c03a4496-a17c-4d3e-85bd-89e085319533 req-edd82db2-0f3b-48b3-bb8d-05eb73542e88 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:30.885243 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-c03a4496-a17c-4d3e-85bd-89e085319533 req-edd82db2-0f3b-48b3-bb8d-05eb73542e88 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:30.887060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-c03a4496-a17c-4d3e-85bd-89e085319533 req-edd82db2-0f3b-48b3-bb8d-05eb73542e88 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:30.918854 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-c03a4496-a17c-4d3e-85bd-89e085319533 req-edd82db2-0f3b-48b3-bb8d-05eb73542e88 service nova] Creating event network-vif-plugged:c03ff667-2411-4f7e-bb83-efebc24e1067 for instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f on hv-cinder-85426 Aug 24 05:48:30.931761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-c03a4496-a17c-4d3e-85bd-89e085319533 req-edd82db2-0f3b-48b3-bb8d-05eb73542e88 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091110 Aug 24 05:48:30.933735 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 183/403] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:31.343592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:31.358127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:31.361330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:31.371052 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-245bf9e0-e46b-42b0-87f7-b6506d7b7e02 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.599388 Aug 24 05:48:31.372011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 221/404] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:30 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:31.796356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:31.797358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:31.807084 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:31.810206 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:31.811581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:31.813043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:31.814567 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:31.815798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:31.816403 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:31.862484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:31.863591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:31.887826 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:31.889309 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:31.890743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:31.895126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:31.896355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:31.897465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:32.223756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:32.239674 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f5c88a28-1034-46b7-8c99-caa7d3fdd0b5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.454232 Aug 24 05:48:32.314446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 184/405] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:31 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:32.396838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:32.397890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:32.413153 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:32.415787 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:32.416370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:32.423685 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:32.425943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:32.426509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:32.843092 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:32.854227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-95384cd4-4da1-4e6e-9091-40e0fba8617b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 1.001391 Aug 24 05:48:32.855343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 222/406] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:31 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:32.900758 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:32.904777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:32.914723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:32.918067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:32.941642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-18ace5f5-32f5-457c-a885-b11c0e27f6cd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.549103 Aug 24 05:48:32.949945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 185/407] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:32 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:32.997111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-4e375be4-6791-42b1-964c-032c0b9fa182 req-db197a5b-8921-4e69-80f3-c1564c66a1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bfde071-16a2-4288-aec1-6d38bb343db6", "tag": "0ca758be-f754-4b9b-998e-751693bc9390"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:33.026679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-4e375be4-6791-42b1-964c-032c0b9fa182 req-db197a5b-8921-4e69-80f3-c1564c66a1ff service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.027159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-4e375be4-6791-42b1-964c-032c0b9fa182 req-db197a5b-8921-4e69-80f3-c1564c66a1ff service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.027587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-4e375be4-6791-42b1-964c-032c0b9fa182 req-db197a5b-8921-4e69-80f3-c1564c66a1ff service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.062384 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-4e375be4-6791-42b1-964c-032c0b9fa182 req-db197a5b-8921-4e69-80f3-c1564c66a1ff service nova] Creating event network-changed:0ca758be-f754-4b9b-998e-751693bc9390 for instance 2bfde071-16a2-4288-aec1-6d38bb343db6 on hv-cinder-85426 Aug 24 05:48:33.077994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-4e375be4-6791-42b1-964c-032c0b9fa182 req-db197a5b-8921-4e69-80f3-c1564c66a1ff service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084783 Aug 24 05:48:33.086613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 223/408] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:33.302605 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:33.303614 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:33.316426 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.317201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.317817 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.318729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.320842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.322111 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.878229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:33.879234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:33.880546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:33.894133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-39007cd0-75cb-48e3-8393-35cec2e10241 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1319 microversion: 2.1 time: 0.596429 Aug 24 05:48:33.902447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.906916 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.907672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.915559 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:33.916123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 186/409] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:33 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1319 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:33.916775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:33.917202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:33.976775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:33.977718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:34.003886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:34.006237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:34.009707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:34.012017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:34.013581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:34.016432 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:34.331604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:34.360472 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c94c8c2d-de33-4ddd-9a25-a4f6e1f7f494 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.488298 Aug 24 05:48:34.363009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 224/410] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:33 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:34.645702 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:34.660276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:34.662309 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:34.663549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1e0a59a5-b56e-48d4-8758-658148a1aee6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.692930 Aug 24 05:48:34.666918 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 187/411] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:33 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:34.915974 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:34.917032 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:34.939222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:34.947836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:34.948474 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:34.954550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:34.955564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:34.956246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.382025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:35.383512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:35.399723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.400982 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.402450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.406250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.407263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.408141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.727108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:35.741283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-950278f1-0849-4ba8-9ae3-279eb694ae2e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1507 microversion: 2.1 time: 0.829225 Aug 24 05:48:35.741930 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 225/412] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:34 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1507 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:35.759280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:35.760158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:35.772357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.777169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.778213 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.779531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:35.780247 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:35.784278 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:35.847041 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:35.885983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b7ac9021-35c6-4043-88d3-a3f2a9e482ab tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.484619 Aug 24 05:48:35.886663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 188/413] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:35 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:48:36.312605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:36.328153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:36.337662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:36.351786 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f014f235-af1b-41ea-a809-89731090e1d0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.599377 Aug 24 05:48:36.354289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 226/414] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:35 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:36.907230 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:36.908014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:36.920816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:36.922121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:36.923249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:36.927479 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:36.929447 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:36.933880 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.380093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:37.380711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:37.400127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.404931 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.405383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.408913 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:37.409405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:37.409862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:37.904052 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:37.952698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0e7b6612-5f20-4add-be80-658d1c0383dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 1.038360 Aug 24 05:48:37.972745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 189/415] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:36 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:38.145849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:38.164932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:38.178234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:38.179473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c2b64962-9677-42f9-9e9f-73758b55f8a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.804662 Aug 24 05:48:38.198538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 227/416] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:37 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:38.982217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:38.983030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:38.998581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:39.000237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:39.000929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:39.001914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:39.002647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:39.003314 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:39.208839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:39.211099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:39.218969 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:39.219840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:39.220624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:39.222401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:39.223147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:39.224209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:39.527049 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:39.542744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d7eccdb0-0f96-4a58-a779-d7f9ce36feee tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.568258 Aug 24 05:48:39.557849 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 190/417] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:38 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:39.887123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-c6955ece-b30b-488a-ad2e-fa1bb4314bd2 req-c0282da5-3ffa-499a-a025-863901abb23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d74183-be9d-44b4-8b74-95591db6be75", "name": "network-vif-plugged", "status": "completed", "tag": "7a0a208c-567e-4aee-9e6e-fb5216b6b6fe"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:39.912628 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-c6955ece-b30b-488a-ad2e-fa1bb4314bd2 req-c0282da5-3ffa-499a-a025-863901abb23b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:39.915140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-c6955ece-b30b-488a-ad2e-fa1bb4314bd2 req-c0282da5-3ffa-499a-a025-863901abb23b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:39.916739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-c6955ece-b30b-488a-ad2e-fa1bb4314bd2 req-c0282da5-3ffa-499a-a025-863901abb23b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:39.950887 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-c6955ece-b30b-488a-ad2e-fa1bb4314bd2 req-c0282da5-3ffa-499a-a025-863901abb23b service nova] Creating event network-vif-plugged:7a0a208c-567e-4aee-9e6e-fb5216b6b6fe for instance e9d74183-be9d-44b4-8b74-95591db6be75 on hv-cinder-85426 Aug 24 05:48:39.966457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-c6955ece-b30b-488a-ad2e-fa1bb4314bd2 req-c0282da5-3ffa-499a-a025-863901abb23b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084015 Aug 24 05:48:39.970572 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 191/418] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:39.976738 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:39.990055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:39.991845 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:39.993230 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6ebc44cc-371a-4e2a-95ac-350cea59ce89 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.790523 Aug 24 05:48:40.021671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 228/419] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:39 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:40.569983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:40.571616 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:40.588499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:40.590825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:40.591515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:40.597538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:40.598381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:40.599087 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:41.029077 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:41.030386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:41.044331 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:41.047058 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:41.048218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:41.051462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:41.052869 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:41.055603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:41.214636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:41.226813 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-983c1227-317d-47db-96f2-cf490dfda371 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.663626 Aug 24 05:48:41.238293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 192/420] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:40 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:41.401657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:41.425931 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:41.429360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:41.431565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9ee312c0-f731-4023-af73-4c1a3d08b3b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.407111 Aug 24 05:48:41.457651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 229/421] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:41 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:42.250914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:42.251535 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:42.272676 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:42.273203 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:42.274110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:42.274548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:42.275012 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:42.282736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:42.515966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:42.516591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:42.557623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:42.558451 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:42.559130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:42.560075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:42.560745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:42.561383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:42.768897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:42.782306 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f6126f7c-3184-424b-b6fd-851a8afff9fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1371 microversion: 2.1 time: 0.535238 Aug 24 05:48:42.782908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 193/422] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:42 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:43.043740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:43.063401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:43.066631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:43.073816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-248f6c8f-53e1-45a7-8280-2edfc1aef085 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.563122 Aug 24 05:48:43.076706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 230/423] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:42 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:43.804478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:43.806076 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:43.822118 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:43.822605 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:43.832352 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:43.837345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:43.845060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:43.849428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:44.103168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:44.104478 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:44.120524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:44.121712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:44.123842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:44.130477 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:44.131444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:44.132144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:44.151644 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:44.558852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:44.582377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:44.590577 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:44.599643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b156106e-5e71-4775-9884-5e61d82237b4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.499805 Aug 24 05:48:44.602693 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 231/424] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:44 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:45.131241 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:45.148194 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fedcf7de-0e6e-4014-90be-986ef8cd5b4a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1565 microversion: 2.1 time: 1.348104 Aug 24 05:48:45.155119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 194/425] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:48:43 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1565 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:48:45.177510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:45.178106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:45.195219 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:45.195995 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:45.201164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:45.202250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:45.202937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:45.203569 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:45.396998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a3f46d63-006f-4b0c-9d44-4e1a093c6184 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.225776 Aug 24 05:48:45.397946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 232/426] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:48:45 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:45.658619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:45.659901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:45.676708 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:45.677682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:45.678419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:45.679499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:45.680168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:45.680845 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:46.239952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:46.256440 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:46.274310 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:46.281757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bbcfff2d-d68f-4cf0-a184-3c8aab538608 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.625812 Aug 24 05:48:46.282502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 195/427] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:45 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:47.307324 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:47.309487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:47.320160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:47.321726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:47.322816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:47.324081 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:47.324782 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:47.325431 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:47.406199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-038636aa-c912-44ab-94eb-b22d262ecf43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Action: 'create', calling method: .version_select at 0x7fa91c4128b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1421150349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPF92Fb13cRzCZKVLeD0dNUDZUzqs3lGaORFhY0JB0XZhhwJklwYw9Rt+TSlqJFDGoM9qk7aPF81GYk2qeeSZsthQmC0ogyeF4LAcJVFGr+aFBO4I9JkIVbE1hVbUNlvMw=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:47.452522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-038636aa-c912-44ab-94eb-b22d262ecf43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Getting quotas for project 1406fa515f224f4b8507331fd22ea4fd. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:48:47.464784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-038636aa-c912-44ab-94eb-b22d262ecf43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Getting quotas for user 135e823ff7f64beab0689c3a84cc268f and project 1406fa515f224f4b8507331fd22ea4fd. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:48:47.550840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-038636aa-c912-44ab-94eb-b22d262ecf43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.629145 Aug 24 05:48:47.553164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 233/428] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:48:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:47.588991 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:47.601009 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:47.603333 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:47.604744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-501a7ac3-85bf-40fa-bd55-8fe7f18074d1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.303891 Aug 24 05:48:47.620908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 196/429] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:47 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:48.504739 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-87268210-cfe0-4f1a-a42b-9c1728c57e4e req-eb615d51-a799-4442-a9b9-b04795cf9406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d74183-be9d-44b4-8b74-95591db6be75", "tag": "7a0a208c-567e-4aee-9e6e-fb5216b6b6fe"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:48.542532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-87268210-cfe0-4f1a-a42b-9c1728c57e4e req-eb615d51-a799-4442-a9b9-b04795cf9406 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:48.543026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-87268210-cfe0-4f1a-a42b-9c1728c57e4e req-eb615d51-a799-4442-a9b9-b04795cf9406 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:48.560866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-87268210-cfe0-4f1a-a42b-9c1728c57e4e req-eb615d51-a799-4442-a9b9-b04795cf9406 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:48.609468 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-87268210-cfe0-4f1a-a42b-9c1728c57e4e req-eb615d51-a799-4442-a9b9-b04795cf9406 service nova] Creating event network-changed:7a0a208c-567e-4aee-9e6e-fb5216b6b6fe for instance e9d74183-be9d-44b4-8b74-95591db6be75 on hv-cinder-85426 Aug 24 05:48:48.634759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:48.636618 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:48.638594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-87268210-cfe0-4f1a-a42b-9c1728c57e4e req-eb615d51-a799-4442-a9b9-b04795cf9406 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137631 Aug 24 05:48:48.639585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 234/430] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:48.653446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:48.655333 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:48.655998 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:48.661973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:48.663276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:48.663922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:49.286770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:49.307354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:49.308941 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:49.310178 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6c50cedc-0abe-4f99-b7fa-7aa124ee73bf tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.680661 Aug 24 05:48:49.311703 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 197/431] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:48 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:48:50.337543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:50.344896 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:50.359532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:50.378563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:50.379376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:50.380657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:50.391043 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:50.391808 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:50.392461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:51.056335 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:51.074773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:51.079306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:51.085661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e5bc59e0-ab95-41ac-916c-58c042a84625 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.752443 Aug 24 05:48:51.087450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 235/432] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:50 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:52.116656 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:52.117942 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:52.145134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:52.152959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:52.155360 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:52.158624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:52.159467 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:52.160154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:52.552195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:52.566831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:52.571579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:52.573720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-41b4557f-e740-4682-8129-d3b01fc2a346 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1739 microversion: 2.20 time: 0.462822 Aug 24 05:48:52.574755 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 198/433] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:52 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1739 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:53.608139 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:53.609643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:53.620377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:53.620858 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:53.621283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:53.622035 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:53.622698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:53.627682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:53.900955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:53.913190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:53.926683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:53.935551 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-08c8ef30-9ccc-4877-b54c-ae8c6558e38a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1721 microversion: 2.20 time: 0.329658 Aug 24 05:48:53.957579 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 236/434] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:53 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1721 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:54.966571 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:54.968420 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:54.982903 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:54.983873 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:54.984517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:54.985728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:54.986815 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:54.987322 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:55.060852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31ec07ac-7365-4374-a2fe-65a747ff0ee2", "device": "/dev/sdb"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:55.063932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:55.084151 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:55.084821 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:55.085485 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:55.086325 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:55.096659 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:55.097283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:55.234517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:55.246820 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:55.249540 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:55.251107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5ed57691-82c7-4b9f-a568-eaaa19c27e33 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1721 microversion: 2.20 time: 0.289518 Aug 24 05:48:55.266946 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 199/435] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:54 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:56.279922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:56.282460 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:56.289966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:56.290449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:56.290884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:56.291617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:56.292693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:56.293120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:56.454145 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:56.465699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:56.467455 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:56.468798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-69770ca0-3310-4cdb-9813-325afcc4599c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1721 microversion: 2.20 time: 0.192810 Aug 24 05:48:56.479442 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 200/436] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:56 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:56.762108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-14a9eefc-3fed-4259-861c-6ba10126c822 req-37ef36fd-4908-48c7-a311-75abaa92c290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d5dce2-87d9-41e2-87bd-e25ffdab7014", "name": "network-vif-unplugged", "status": "completed", "tag": "837c49ba-3839-4640-af5d-797916aa3934"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:56.762108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-14a9eefc-3fed-4259-861c-6ba10126c822 req-37ef36fd-4908-48c7-a311-75abaa92c290 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:56.762108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-14a9eefc-3fed-4259-861c-6ba10126c822 req-37ef36fd-4908-48c7-a311-75abaa92c290 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:56.762108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-14a9eefc-3fed-4259-861c-6ba10126c822 req-37ef36fd-4908-48c7-a311-75abaa92c290 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:56.770859 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-14a9eefc-3fed-4259-861c-6ba10126c822 req-37ef36fd-4908-48c7-a311-75abaa92c290 service nova] Creating event network-vif-unplugged:837c49ba-3839-4640-af5d-797916aa3934 for instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 on hv-cinder-85426 Aug 24 05:48:56.776599 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-14a9eefc-3fed-4259-861c-6ba10126c822 req-37ef36fd-4908-48c7-a311-75abaa92c290 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044374 Aug 24 05:48:56.777398 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 201/437] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:48:57.395708 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f9f35c1b-26a1-47fc-a4e2-5f241c49ddb9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "POST /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.338923 Aug 24 05:48:57.400283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 237/438] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:48:55 2022] POST /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f/os-volume_attachments => generated 194 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:48:57.495434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:57.496217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:57.503647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.504406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.504988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:57.505863 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.506478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.507155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:57.687973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:57.705541 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:57.712486 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:57.714722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e5f1a4ca-2cec-4c82-bb9d-fa9d42e2f802 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1724 microversion: 2.20 time: 0.223668 Aug 24 05:48:57.735110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 202/439] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:57 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:48:57.738704 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=4 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:57.743529 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "146be8de-5993-49bd-9742-f6842b37386f"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:57.747003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:57.771147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.772193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.772639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:57.773378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:57.773875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:57.774298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:58.349843 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-478a398b-9e7d-4b57-aaf7-a908c5bc47fa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.612180 Aug 24 05:48:58.351119 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 238/440] 10.222.0.73 () {62 vars in 1364 bytes} [Wed Aug 24 05:48:57 2022] POST /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments => generated 188 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:48:58.538785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:48:58.539926 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:58.549010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:58.549886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:58.550765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:58.552491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:58.553069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:58.559545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:58.625604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127193) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:48:58.669956 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:48:58.753040 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-717161d4-5ac4-4a75-acfa-aacf6079bc07 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/action" status: 202 len: 0 microversion: 2.20 time: 0.223406 Aug 24 05:48:58.759587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 203/441] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 05:48:58 2022] POST /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:48:58.762478 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:48:58.763567 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:48:58.773679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:58.774376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:58.774970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:58.776040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:48:58.776639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:48:58.777285 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:48:58.954386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:58.965452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:58.967886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:48:58.974050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-46604c42-ff6c-4899-8a13-f263773f5486 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.215636 Aug 24 05:48:58.975163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 239/442] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:58 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:00.004875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:00.005537 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:00.016320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:00.017299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:00.017914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:00.018788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:00.019790 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:00.020380 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:00.241857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:00.270474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:00.272186 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:00.273416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fdf7a733-8619-447b-8d4d-c32de63d930f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.275325 Aug 24 05:49:00.274349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 204/443] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:48:59 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:01.308419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:01.309621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:01.324753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:01.325481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:01.326164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:01.327125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:01.327898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:01.331433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:01.636612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:01.649594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:01.651979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:01.653934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c8d6bf26-d03d-44ae-8a4f-a982df5bf736 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.349370 Aug 24 05:49:01.655403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 240/444] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:01 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:02.676456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:02.677763 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:02.680365 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:02.685742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:02.686367 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:02.686964 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:02.687921 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:02.688586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:02.689198 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:02.868030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:02.884538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:02.887227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:02.888628 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-abed2463-cb38-4aaf-9af3-715c336b9ccb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.216197 Aug 24 05:49:02.901278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 205/445] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:02 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:03.924290 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:03.924966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:03.932096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:03.932681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:03.933187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:03.934012 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:03.934923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:03.937333 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:04.118430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:04.133414 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:04.135413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:04.136582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2ef8ade6-710d-4136-819e-0d959409ba92 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.227291 Aug 24 05:49:04.148474 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 241/446] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:03 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:04.323552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6b5594fe-f558-4f3c-be56-8f9934eade3b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Action: 'create', calling method: .version_select at 0x7fa91cc45940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1830396125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzcreYOlhZIRlux+71T5TpITR1AsFXoeeQ+raRaSHJpHXuzhDCl75JhNBOBA5OoDz2idQZ2AAygt4bvH4n87xQ8U3zkUuXPVEZKxKmtwmd5am10Z3sXlNcHCKNWoeDg3w=="}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:04.346228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-6b5594fe-f558-4f3c-be56-8f9934eade3b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Getting quotas for project 3d5351c28cfa4491bfa37944aa187737. Resources: {'key_pairs'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:04.350084 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-6b5594fe-f558-4f3c-be56-8f9934eade3b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Getting quotas for user 9b5f4bd410b544e29c4c569c225a93ed and project 3d5351c28cfa4491bfa37944aa187737. Resources: {'key_pairs'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:04.388977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6b5594fe-f558-4f3c-be56-8f9934eade3b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.069454 Aug 24 05:49:04.389638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 206/447] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:49:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:04.445115 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-961490268", "imageRef": "87f76393-d2b8-4c8f-9103-9574f9f167c2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1830396125", "networks": [{"uuid": "f40290f2-f4c8-459c-9121-b3025b6e2e02"}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:04.513009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] validate_networks() for [('f40290f2-f4c8-459c-9121-b3025b6e2e02', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:49:04.933959 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:49:04.935379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:49:04.935744 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:49:04.936384 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:49:04.936799 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:49:04.947633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:04.948112 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:04.948538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:04.949255 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:04.949743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:04.950163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:04.968521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Getting quotas for project 3d5351c28cfa4491bfa37944aa187737. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:04.972841 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Getting quotas for user 9b5f4bd410b544e29c4c569c225a93ed and project 3d5351c28cfa4491bfa37944aa187737. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:04.984968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:49:04.987852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='87f76393-d2b8-4c8f-9103-9574f9f167c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:49:05.034488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-48db4c5c-2caf-4bde-9d6a-b8a1c0434d46 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594475 Aug 24 05:49:05.035157 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 242/448] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:49:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:49:05.046446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9c560f17-b33e-47fc-ae34-e0d8c8649ee7 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:05.047072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9c560f17-b33e-47fc-ae34-e0d8c8649ee7 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:05.109688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9c560f17-b33e-47fc-ae34-e0d8c8649ee7 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:05.119062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9c560f17-b33e-47fc-ae34-e0d8c8649ee7 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1258 microversion: 2.1 time: 0.077025 Aug 24 05:49:05.119940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 207/449] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:05 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:05.162777 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:05.163538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:05.171679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:05.174208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:05.174665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:05.175408 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:05.175866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:05.176293 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:05.346310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:05.362786 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:05.364583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:05.365947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-df9c61ed-ffcf-4484-9e8f-4fd60927578e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.208579 Aug 24 05:49:05.366833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 243/450] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:05 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:06.140340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:06.140957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:06.147659 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:06.148142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:06.148578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:06.149277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:06.149781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:06.150207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:06.215108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:06.223337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6bdf51ce-54b4-4bf2-b1ce-fe802d90257c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1262 microversion: 2.1 time: 0.087051 Aug 24 05:49:06.223920 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 208/451] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:06 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:06.389627 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:06.390180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:06.396915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:06.397391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:06.397854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:06.398548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:06.399003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:06.399421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:06.530301 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:06.539554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:06.541061 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:06.542249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6f8838ad-e790-4dc3-8439-cd7a02ac559a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.156628 Aug 24 05:49:06.542805 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 244/452] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:06 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:07.244548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:07.245164 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:07.251936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:07.252414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:07.252850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:07.253551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:07.254026 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:07.254450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:07.315903 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:07.323936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ef1f28ce-1ef5-481d-aa0f-b1f86a25a9a1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1262 microversion: 2.1 time: 0.083208 Aug 24 05:49:07.324615 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 209/453] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:07 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:07.565593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:07.566144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:07.572533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:07.573019 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:07.573449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:07.574159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:07.574618 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:07.575039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:07.707368 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:07.715855 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:07.717357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:07.718536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7aa765bd-41a7-413e-afd6-21fb558f74e2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.157583 Aug 24 05:49:07.719099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 245/454] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:07 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:08.348769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:08.349404 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:08.355772 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:08.356246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:08.356676 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:08.357363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:08.357834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:08.358260 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:08.420582 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:08.429041 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a758457b-e8e4-4fe4-86af-6712b555a508 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1262 microversion: 2.1 time: 0.084586 Aug 24 05:49:08.429615 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 210/455] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:08 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:08.741469 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:08.742107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:08.748584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:08.749091 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:08.749522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:08.750238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:08.750686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:08.751138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:08.771310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:08.884421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:08.893055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:08.894740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:08.895750 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f0c6885e-7b88-4154-a195-f52710f5c075 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1750 microversion: 2.20 time: 0.158056 Aug 24 05:49:08.896314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 246/456] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:08 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:09.449540 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:09.450174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:09.457419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:09.458003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:09.458335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:09.459029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:09.459474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:09.459889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:09.520714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:09.529362 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-eae36833-5b35-4473-b4cc-2d176e885f10 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1262 microversion: 2.1 time: 0.083667 Aug 24 05:49:09.529908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 211/457] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:09 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:09.918707 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:09.919311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:09.926431 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:09.926911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:09.927343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:09.928037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:09.928492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:09.928915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:10.069549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:10.078736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:10.080239 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:10.081521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1696b647-bdae-414a-b97d-676a1fb71a91 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1752 microversion: 2.20 time: 0.166754 Aug 24 05:49:10.082157 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 247/458] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:09 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:10.551081 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:10.552091 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:10.559779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:10.560267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:10.560897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:10.562154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:10.562757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:10.563232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:10.637649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:10.647124 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-98e46c22-768c-482b-93fd-d33a3a33c7d2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1254 microversion: 2.1 time: 0.099905 Aug 24 05:49:10.648013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 212/459] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:10 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1254 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:11.106521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:11.107130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:11.113859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:11.114344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:11.114777 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:11.115466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:11.115975 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:11.116384 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:11.245714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:11.255231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:11.256745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:11.257937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7e8454c2-1638-431b-9ac3-0bf12111258d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1752 microversion: 2.20 time: 0.156220 Aug 24 05:49:11.258493 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 248/460] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:11 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:11.669917 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:11.672646 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:11.680585 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:11.681492 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:11.682176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:11.683303 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:11.685215 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:11.686036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:11.834221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:11.844089 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-405a9c52-fa93-47d4-a8da-b0fb93b9523d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1316 microversion: 2.1 time: 0.179359 Aug 24 05:49:11.844655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 213/461] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:11 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:11.945441 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-514222643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1421150349", "security_groups": [{"name": "tempest-secgroup-smoke-1337348577"}], "networks": [{"uuid": "ed0161f2-8902-4485-b44f-21cba572283b"}], "block_device_mapping_v2": [{"uuid": "8e23b324-e258-49a8-abbe-574af8d3baf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:12.176638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] validate_networks() for [('ed0161f2-8902-4485-b44f-21cba572283b', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:49:12.283770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:12.284544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:12.300328 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:12.300994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:12.301555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:12.302416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:12.302979 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:12.303508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:12.602901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:12.613712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:12.615276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:12.616539 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2a28ec83-f65b-4f0d-9825-d3362d940159 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.337435 Aug 24 05:49:12.617111 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 214/462] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:12 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:12.822977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:49:12.823403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:49:12.823873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:49:12.824313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:49:12.824720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:49:12.834163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:12.834649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:12.835107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:12.835833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:12.836284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:12.836709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:12.854218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Getting quotas for project 1406fa515f224f4b8507331fd22ea4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:12.857907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Getting quotas for user 135e823ff7f64beab0689c3a84cc268f and project 1406fa515f224f4b8507331fd22ea4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:12.867068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:12.868334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:12.875901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:12.877331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:12.877978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:12.878891 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:12.879522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:12.880120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:12.918193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:49:12.920339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e23b324-e258-49a8-abbe-574af8d3baf2',volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:49:13.048784 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:13.059009 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-77cffdb8-67b9-4f2f-b597-00dcf1079925 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.197589 Aug 24 05:49:13.060428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 215/463] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:12 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:13.099244 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e68cfeaf-b169-48e3-8d2d-6ecc4112fe84 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.157857 Aug 24 05:49:13.105999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 249/464] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:49:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:49:13.111587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e2c75acf-5512-4843-b7de-21c98b424b09 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:13.112199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e2c75acf-5512-4843-b7de-21c98b424b09 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:13.172041 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e2c75acf-5512-4843-b7de-21c98b424b09 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:13.179629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e2c75acf-5512-4843-b7de-21c98b424b09 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1088 microversion: 2.1 time: 0.072232 Aug 24 05:49:13.180532 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 216/465] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:13 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:13.641194 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:13.642047 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:13.649232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:13.650043 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:13.650857 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:13.651861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:13.652548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:13.653213 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:13.790939 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:13.803438 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:13.804962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:13.806138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-276e257f-a5f1-4920-84ce-55c794e851c3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.169656 Aug 24 05:49:13.806905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 250/466] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:13 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:14.080876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:14.082463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:14.091351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:14.092341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:14.093365 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:14.094498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:14.095101 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:14.096405 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:14.199791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:14.200546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:14.207278 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:14.207834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:14.208415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:14.209324 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:14.210016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:14.210497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:14.235657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:14.245014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7e943bba-4534-4b99-a2e0-6b895a31fc62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.168668 Aug 24 05:49:14.245897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 217/467] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:14 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:14.276873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:14.284892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ab595c71-5554-4411-92d7-6d679af61832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.088837 Aug 24 05:49:14.285640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 251/468] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:14 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:14.828290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:14.828916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:14.835082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:14.835551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:14.835992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:14.836655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:14.837095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:14.837507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:14.976330 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:14.985219 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:14.986761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:14.987919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-57a8a967-8290-4971-9e8e-14b4b86ed5dd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.163581 Aug 24 05:49:14.988485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 218/469] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:14 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:15.266105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:15.266718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:15.279363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:15.280044 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:15.280636 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:15.281495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:15.282160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:15.282790 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:15.305288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:15.306043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:15.313205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:15.313979 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:15.315075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:15.315967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:15.316579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:15.317158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:15.395845 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:15.404517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-26ae869c-c1ff-4665-ac03-4ba1f94b6eda tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.102999 Aug 24 05:49:15.405144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 219/470] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:15 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:15.430551 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:15.441618 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-28c18541-2a5b-4ce1-b5e9-09677fb4c622 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.176120 Aug 24 05:49:15.441618 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 252/471] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:15 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:16.011606 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:16.012214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:16.018719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:16.018988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:16.019307 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:16.019957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:16.020408 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:16.020832 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:16.188497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:16.197603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:16.199119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:16.200295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b8e2c68a-e169-406d-a7ae-0db6e6cc72e0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.192599 Aug 24 05:49:16.200874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 220/472] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:16 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:16.425287 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:16.425907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:16.432622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:16.433098 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:16.433523 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:16.434252 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:16.434695 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:16.435116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:16.465264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:16.465264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:16.470122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:16.470647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:16.471610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:16.472379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:16.472781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:16.473207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:16.507763 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:16.515517 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b0953c5a-7191-4ee4-90dc-2393d5043832 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.094002 Aug 24 05:49:16.517168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 253/473] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:16 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:16.626158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:16.634965 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c756da7a-a6a7-4bd4-b4af-eda2f5c0fc1a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.178471 Aug 24 05:49:16.635805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 221/474] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:16 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:17.224767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:17.225375 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:17.231592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:17.232074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:17.232506 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:17.233198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:17.233930 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:17.234347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:17.379038 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:17.387870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:17.389367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:17.390554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0d08f029-800c-4da7-82b6-ac76d5646b1c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.170602 Aug 24 05:49:17.400107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 254/475] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:17 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:17.537707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:17.538265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:17.544566 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:17.545054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:17.545489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:17.546207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:17.546663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:17.547084 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:17.567400 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:17.613713 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:17.621575 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2c820bd8-95cf-4561-8f0c-b41a992c8a80 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.087753 Aug 24 05:49:17.622264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 222/476] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:17 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:17.656283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:17.656889 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:17.663946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:17.664495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:17.665124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:17.666049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:17.666674 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:17.667102 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:17.828269 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:17.836606 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ed74d29a-a567-4e38-94a5-9efea2e713c9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.184253 Aug 24 05:49:17.837188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 255/477] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:17 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:18.415339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:18.416321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:18.422738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.423448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.424022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:18.424866 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.425449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.426044 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:18.563038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:18.572131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:18.573652 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:18.574807 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-97917eed-f89f-4a87-8743-8d835e51d29c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.163370 Aug 24 05:49:18.575364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 223/478] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:18 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:18.644789 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:18.645550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:18.651515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.652246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.652833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:18.653731 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.654325 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.654895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:18.727295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:18.735441 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e557269e-a046-46e9-a380-f648854db631 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.095420 Aug 24 05:49:18.740990 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 256/479] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:18 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:18.857089 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:18.857741 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:18.864525 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.865002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.865430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:18.866146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:18.866598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:18.867016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:19.007294 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:19.014937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5aef5a25-551c-4f8d-8db6-7e68d3229790 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.161707 Aug 24 05:49:19.015521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 224/480] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:18 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:19.598999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:19.599605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:19.606514 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:19.607499 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:19.608223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:19.609403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:19.610269 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:19.610958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:19.746629 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:19.757126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:19.758580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:19.759735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-87b32435-4e1d-4932-ad21-de4f7cf2d43a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.165110 Aug 24 05:49:19.760060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:19.773776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 257/481] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:19 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:19.773941 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:19.775081 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:19.775845 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:19.776282 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:19.777123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:19.777606 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:19.778093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:19.854246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:19.863386 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-912c54e0-f01e-4605-a8f1-43f1d821e6bb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.107504 Aug 24 05:49:19.863958 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 225/482] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:19 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:20.036372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:20.036980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:20.043260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.043717 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.044140 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.044825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.045267 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.045709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.186605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:20.194570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d5d639c7-d9a6-4947-b40e-0b9a8b4f6bcb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.162544 Aug 24 05:49:20.195161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 258/483] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:20 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:20.785002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:20.786356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:20.792950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.793452 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.793914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.794608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.795050 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.795466 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.884207 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:20.885308 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:20.887905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:20.896868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.897372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.897840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.898550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:20.899007 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:20.900083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:20.948261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:20.957172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:20.958731 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:20.959891 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c9618b7b-878c-4573-836b-26ed0550140f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.179814 Aug 24 05:49:20.960486 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 226/484] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:20 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:20.969862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:20.980761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4eb917a9-6626-44e5-8db1-b7380620325d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.100332 Aug 24 05:49:20.981341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 259/485] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:20 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:21.215777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:21.216422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:21.223007 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:21.223536 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:21.223922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:21.224619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:21.225060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:21.225482 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:21.352745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:21.360614 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2784e129-eb2d-4fda-b6f1-435bcf32c78b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.148791 Aug 24 05:49:21.361183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 227/486] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:21 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:21.984153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:21.984757 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:21.991055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:21.991534 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:21.991968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:21.992649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:21.993101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:21.993520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:22.002775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:22.003551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:22.010911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:22.011484 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:22.011931 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:22.012639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:22.013100 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:22.013526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:22.074777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:22.083382 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b5026ef9-94b0-4849-8009-99eb3e293022 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.085195 Aug 24 05:49:22.083957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 228/487] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:21 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:22.123878 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:22.133525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:22.135096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:22.136319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3fb41051-f544-4aad-8c35-161cab209d3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.156211 Aug 24 05:49:22.136882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 260/488] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:21 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:22.380757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:22.381371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:22.387345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:22.387826 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:22.388261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:22.388955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:22.389404 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:22.389862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:22.517154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:22.525707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-eca850c3-9e83-4b2d-aa58-9629d572e733 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.149342 Aug 24 05:49:22.526217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 229/489] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:22 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:23.103967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:23.104609 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:23.106570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=4 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:23.107249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=12 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:23.114784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.115330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.115897 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.116599 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.117052 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.117476 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.159775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:23.160381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:23.166758 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.167223 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.167650 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.168338 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.168787 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.169200 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.181302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:23.184233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=8 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:23.189460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-245c040f-5c07-416a-8c43-9392c1f92af3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1138 microversion: 2.1 time: 0.089393 Aug 24 05:49:23.190062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 261/490] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:23 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:23.299743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:23.308249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:23.309809 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:23.310964 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c95ba7ea-2529-4559-8d9d-74c651272f56 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.155771 Aug 24 05:49:23.311521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 230/491] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:23 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:23.546541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:23.547154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:23.553045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.553524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.553985 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.554664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:23.555114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:23.555533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:23.688289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:23.697444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-61c5ff38-7228-42e1-9ba0-88176a37ec70 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.153568 Aug 24 05:49:23.697444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 262/492] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:23 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:24.211177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:24.211816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:24.219191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.219681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.220181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.220889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.221516 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.221977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.315916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:24.323824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1212887d-959e-4314-a9a7-aaa4562720b3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1186 microversion: 2.1 time: 0.116366 Aug 24 05:49:24.324413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 231/493] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:24 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1186 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:24.342765 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:24.343533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:24.350503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.350984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.351415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.352168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.352640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.353111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.489743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:24.493206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:24.499213 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:24.500715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:24.503232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-396bacdd-541e-4bda-a6bc-41fe5aed1156 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.162978 Aug 24 05:49:24.503232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 263/494] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:24 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:24.605787 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-4b21b08c-e6bc-4f2f-a2fd-3a6d0b327c5f req-a936336d-29b5-4c99-a975-3a8a31ca21e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ce9d76-06ce-40b3-91a3-ccf2af253a09", "tag": "a5494de2-9b32-433b-9632-7ff022a2fa4d"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:24.626022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4b21b08c-e6bc-4f2f-a2fd-3a6d0b327c5f req-a936336d-29b5-4c99-a975-3a8a31ca21e5 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.627556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4b21b08c-e6bc-4f2f-a2fd-3a6d0b327c5f req-a936336d-29b5-4c99-a975-3a8a31ca21e5 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.628639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4b21b08c-e6bc-4f2f-a2fd-3a6d0b327c5f req-a936336d-29b5-4c99-a975-3a8a31ca21e5 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.646824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-4b21b08c-e6bc-4f2f-a2fd-3a6d0b327c5f req-a936336d-29b5-4c99-a975-3a8a31ca21e5 service nova] Creating event network-changed:a5494de2-9b32-433b-9632-7ff022a2fa4d for instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 on hv-cinder-85426 Aug 24 05:49:24.652012 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-4b21b08c-e6bc-4f2f-a2fd-3a6d0b327c5f req-a936336d-29b5-4c99-a975-3a8a31ca21e5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054037 Aug 24 05:49:24.652939 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 232/495] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:24.719279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:24.719896 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:24.732290 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.732785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.733842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.734240 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:24.734675 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:24.735099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:24.924208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:24.937276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c9b6670a-d28b-46a1-bddd-340986f66dff tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.222271 Aug 24 05:49:24.938108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 264/496] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:24 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:25.346179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:25.346798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:25.353095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.353609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.354051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:25.354846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.355925 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.356361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:25.483118 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:25.494379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-69347237-6b47-4e8f-b180-e37aebe825a0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1204 microversion: 2.1 time: 0.153545 Aug 24 05:49:25.495571 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 233/497] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:25 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1204 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:25.524797 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:25.525449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:25.531994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.532502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.532947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:25.534144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.534554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.535127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:25.695327 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:25.704475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:25.706833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:25.708212 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-76db8316-12f8-44f5-989e-a6fa164f21f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.187464 Aug 24 05:49:25.708886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 265/498] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:25 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:25.957668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:25.958483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:25.964668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.965231 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.965797 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:25.966497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:25.967148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:25.967576 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.185542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:26.186637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:26.194401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.195352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.196422 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.197357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.198041 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.198571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.217813 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:26.227800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-381f2aa7-51fb-4d36-937b-c7f474111f0d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.274055 Aug 24 05:49:26.228009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-76871eea-eeaf-4866-83d8-ed1a173fe8a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6/ips" status: 200 len: 149 microversion: 2.1 time: 0.046905 Aug 24 05:49:26.228671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 266/499] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:49:26 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:49:26.241534 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "915acc62-8e95-4a95-bd44-c6508560b165"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:26.244400 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:26.246177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 234/500] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:25 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:26.257887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.258402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.258841 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.259562 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.260014 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.260613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.344913 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Invalid volume: volume 915acc62-8e95-4a95-bd44-c6508560b165 is already attached to instances: 0914a19f-ad14-4b39-84b5-dc7296adcf95 Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: POST /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6/os-volume_attachments HTTP/1.1 Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 74 Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:49:26.347218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {"volumeAttachment": {"volumeId": "915acc62-8e95-4a95-bd44-c6508560b165"}} Aug 24 05:49:26.348856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Invalid volume: volume 915acc62-8e95-4a95-bd44-c6508560b165 is already attached to instances: 0914a19f-ad14-4b39-84b5-dc7296adcf95 Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'server_id': '2bfde071-16a2-4288-aec1-6d38bb343db6', 'body': {'volumeAttachment': {'volumeId': '915acc62-8e95-4a95-bd44-c6508560b165'}}} Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 915acc62-8e95-4a95-bd44-c6508560b165 is already attached to instances: 0914a19f-ad14-4b39-84b5-dc7296adcf95 Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:26.349828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 915acc62-8e95-4a95-bd44-c6508560b165 is already attached to instances: 0914a19f-ad14-4b39-84b5-dc7296adcf95 Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:26.351232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 915acc62-8e95-4a95-bd44-c6508560b165 is already attached to instances: 0914a19f-ad14-4b39-84b5-dc7296adcf95 Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 400 to user: Invalid volume: volume 915acc62-8e95-4a95-bd44-c6508560b165 is already attached to instances: 0914a19f-ad14-4b39-84b5-dc7296adcf95 {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-27a53ea9-71f1-458c-a694-3b672d7c4246 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111284 Aug 24 05:49:26.352646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 267/501] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:49:26 2022] POST /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:49:26.357523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:26.358080 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:26.365506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.366013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.366444 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.367137 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.367581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.368005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.393402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:49:26.467093 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4ebb3a0d-9006-44ac-b3b3-623350a79277 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 204 len: 0 microversion: 2.1 time: 0.113142 Aug 24 05:49:26.467590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 235/502] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:49:26 2022] DELETE /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:49:26.476438 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:26.477042 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:26.485503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.486665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.487075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.487760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.488206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.488625 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.516503 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:26.517250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:26.523292 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.523765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.524193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.524879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.525321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.525790 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.619934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:26.627979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c605d66a-0633-456a-bc12-91acd339c896 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1680 microversion: 2.1 time: 0.155302 Aug 24 05:49:26.628552 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 268/503] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:26 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:26.662710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:26.670491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e7ca80df-3088-42e3-999f-e25946a14292 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.158139 Aug 24 05:49:26.671053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 236/504] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:26 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:26.732072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:26.732682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:26.739039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.739531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.739976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.740656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:26.741106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:26.741529 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:26.870635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:26.879018 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:26.880575 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:26.881745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8e818189-f3e5-4751-a161-fa0c5e227c5f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.153515 Aug 24 05:49:26.882295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 269/505] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:26 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:27.256825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:27.257498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:27.264749 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.265428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.265957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.267010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.267148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.268068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.483299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:27.491763 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-db680f90-6ee1-4e5e-9274-9423832cc0a3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.240703 Aug 24 05:49:27.492334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 237/506] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:27 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:27.650961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:27.651694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:27.658402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.659111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.659849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.660565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.661015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.661433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.692895 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:27.693510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:27.699789 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.700269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.700698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.701402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.701879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.702299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.707202 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:27.809761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:27.817891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-54552ae1-5f5e-4753-990b-fc0cebb8d298 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1680 microversion: 2.1 time: 0.170844 Aug 24 05:49:27.818792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 270/507] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:27 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:27.904408 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:27.904956 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:27.912112 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.912593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.913025 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.913750 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:27.914205 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:27.914621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:27.955329 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:27.964806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c4a8ae10-cb77-4d80-8aaa-81be7921163f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.276986 Aug 24 05:49:27.965604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 238/508] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:27 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:28.057804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:28.069271 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:28.070839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:28.072019 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-66014a51-ba6f-444b-b6c8-d4a09d65b6e5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.171667 Aug 24 05:49:28.086048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 271/509] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:27 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:28.087056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:28.087562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:28.093080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-2bcc0659-ef20-4102-93c1-0c2832b22af4 req-1c594bd9-3e16-4c86-a74f-cd65450830de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977405bb-cdcc-4b20-b7ae-754ab660c7c3", "tag": "477bcaf5-dea4-412c-a5c0-a5d8080b11f0"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:28.096624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.097106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.097535 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.098287 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.098730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.099148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.103154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-2bcc0659-ef20-4102-93c1-0c2832b22af4 req-1c594bd9-3e16-4c86-a74f-cd65450830de service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.103639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-2bcc0659-ef20-4102-93c1-0c2832b22af4 req-1c594bd9-3e16-4c86-a74f-cd65450830de service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.104070 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-2bcc0659-ef20-4102-93c1-0c2832b22af4 req-1c594bd9-3e16-4c86-a74f-cd65450830de service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.115319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-2bcc0659-ef20-4102-93c1-0c2832b22af4 req-1c594bd9-3e16-4c86-a74f-cd65450830de service nova] Creating event network-changed:477bcaf5-dea4-412c-a5c0-a5d8080b11f0 for instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 on hv-cinder-85426 Aug 24 05:49:28.120850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-2bcc0659-ef20-4102-93c1-0c2832b22af4 req-1c594bd9-3e16-4c86-a74f-cd65450830de service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033622 Aug 24 05:49:28.121499 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 272/510] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:28.226637 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lazy-loading 'services' on Instance uuid 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:49:28.338801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8682d41a-9cda-492c-aa2b-bd2ed19aae0a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f/os-volume_attachments/31ec07ac-7365-4374-a2fe-65a747ff0ee2" status: 202 len: 0 microversion: 2.1 time: 0.255796 Aug 24 05:49:28.339393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 239/511] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:49:28 2022] DELETE /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f/os-volume_attachments/31ec07ac-7365-4374-a2fe-65a747ff0ee2 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:49:28.513579 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:28.514583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:28.521259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.521949 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.522387 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.523085 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.523540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.524008 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.655012 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:28.663072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-58ba0ac0-e9b2-488a-a0d3-440697954dc2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.153830 Aug 24 05:49:28.663652 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 273/512] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:28 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:28.839649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:28.840472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:28.847268 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.847831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.848331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.849084 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.849515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.849953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.981710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:28.986300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:28.986918 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:28.991715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-19a0a263-33a3-418e-8873-a9947c131af6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1680 microversion: 2.1 time: 0.156150 Aug 24 05:49:28.992814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.993289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.993751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:28.994496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:28.994940 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:28.995350 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:29.006080 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 240/513] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:28 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:29.099620 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:29.100401 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:29.106355 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:29.106916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:29.107424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:29.108118 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:29.108834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:29.109255 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:29.133604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:29.141334 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d105ff93-fdc7-4516-a833-17b30b523b2d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.159555 Aug 24 05:49:29.141943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 274/514] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:28 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:29.239495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:29.252011 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:29.253820 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:29.255528 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1cc51ae4-09c4-492f-bc36-d8e89cc643fc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.160435 Aug 24 05:49:29.256349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 241/515] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:29 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:29.683248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:29.684502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:29.698186 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:29.699169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:29.700505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:29.708091 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:29.709046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:29.709490 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:29.970885 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:29.982626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1605f063-ddf2-4d2a-94c9-8f6bd4d70c0b tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.303268 Aug 24 05:49:29.984026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 275/516] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:29 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:30.022565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:30.024051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:30.034054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.035258 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.036324 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.037929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.038738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.039417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.163683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:30.164581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:30.171845 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.172341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.172770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.174099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.174728 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.175319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.278323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:30.291242 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b318ac12-7a7c-4d51-96a9-331789a6a349 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1680 microversion: 2.1 time: 0.272770 Aug 24 05:49:30.292496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 242/517] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:30 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:30.304047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:30.305735 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:30.319116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.320065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.320738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.321718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.322392 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.323035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.430072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:30.442044 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-06deb692-b9fa-4c5f-b3ee-82bc13bb6045 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.282628 Aug 24 05:49:30.442836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 276/518] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:30 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:30.602070 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:30.604926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:30.613683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.614473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.615091 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.615981 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.616468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:30.616774 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.617349 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.636537 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:30.639086 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:30.643376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e98805f3-0f4e-46ad-8127-32f373d49cb5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.346909 Aug 24 05:49:30.644914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 243/519] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:30 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:30.654298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:49:30.766074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-216862a0-95d1-45de-94b2-494f44eb48b6 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 204 len: 0 microversion: 2.1 time: 0.166713 Aug 24 05:49:30.768844 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 277/520] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:49:30 2022] DELETE /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:49:30.789179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:30.789972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:30.804751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.805586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.806777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:30.807604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:30.808370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:30.808993 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.004842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:31.005494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:31.015800 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.016226 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.016640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.017384 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.017852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.022335 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.099989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.109550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-65ccc023-8d77-4ec4-8000-35dbcbe5ae7b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1559 microversion: 2.1 time: 0.334893 Aug 24 05:49:31.110144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 244/521] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:30 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1559 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:31.114953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-4a471fbe-8526-47bd-943c-97cada50de87 req-082d1ce5-9f50-4806-b24e-9a2c81d5bfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bfde071-16a2-4288-aec1-6d38bb343db6", "name": "network-vif-deleted", "tag": "0ca758be-f754-4b9b-998e-751693bc9390"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:31.122898 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:31.127149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4a471fbe-8526-47bd-943c-97cada50de87 req-082d1ce5-9f50-4806-b24e-9a2c81d5bfd6 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.127823 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4a471fbe-8526-47bd-943c-97cada50de87 req-082d1ce5-9f50-4806-b24e-9a2c81d5bfd6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.128454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4a471fbe-8526-47bd-943c-97cada50de87 req-082d1ce5-9f50-4806-b24e-9a2c81d5bfd6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.147314 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-4a471fbe-8526-47bd-943c-97cada50de87 req-082d1ce5-9f50-4806-b24e-9a2c81d5bfd6 service nova] Creating event network-vif-deleted:0ca758be-f754-4b9b-998e-751693bc9390 for instance 2bfde071-16a2-4288-aec1-6d38bb343db6 on hv-cinder-85426 Aug 24 05:49:31.154223 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-4a471fbe-8526-47bd-943c-97cada50de87 req-082d1ce5-9f50-4806-b24e-9a2c81d5bfd6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042529 Aug 24 05:49:31.155733 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 245/522] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:31.239020 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-f15b9732-6361-4e41-b48f-4e7df4edd3ed req-4420caf3-47e5-4142-8e8a-e6cc83fd4850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ce9d76-06ce-40b3-91a3-ccf2af253a09", "name": "network-vif-plugged", "status": "completed", "tag": "a5494de2-9b32-433b-9632-7ff022a2fa4d"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:31.280798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-f15b9732-6361-4e41-b48f-4e7df4edd3ed req-4420caf3-47e5-4142-8e8a-e6cc83fd4850 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.282290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-f15b9732-6361-4e41-b48f-4e7df4edd3ed req-4420caf3-47e5-4142-8e8a-e6cc83fd4850 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.285058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-f15b9732-6361-4e41-b48f-4e7df4edd3ed req-4420caf3-47e5-4142-8e8a-e6cc83fd4850 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.319676 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-f15b9732-6361-4e41-b48f-4e7df4edd3ed req-4420caf3-47e5-4142-8e8a-e6cc83fd4850 service nova] Creating event network-vif-plugged:a5494de2-9b32-433b-9632-7ff022a2fa4d for instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 on hv-cinder-85426 Aug 24 05:49:31.338194 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-f15b9732-6361-4e41-b48f-4e7df4edd3ed req-4420caf3-47e5-4142-8e8a-e6cc83fd4850 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109933 Aug 24 05:49:31.341510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 246/523] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:31.358226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:31.359737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:31.380347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.381239 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.381908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.382934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.383649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.384291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.467246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.478191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6209a62d-b4b6-4607-9cef-a7b69fee11d1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1613 microversion: 2.1 time: 0.134929 Aug 24 05:49:31.479133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 247/524] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:31 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1613 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:31.489721 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:31.506262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:31.506262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.506262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.506262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.506761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.506761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.506761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.655553 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.659210 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a64bb05f-7d14-4700-be2c-7c9140dbd855 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.658627 Aug 24 05:49:31.659895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 278/525] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:30 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:31.674985 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:31.679010 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:31.702125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.705860 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.706366 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.708419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:31.708953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:31.710309 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:31.736352 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.745450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d433cf87-68a6-4f22-aab3-548fc7fa21ca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.265059 Aug 24 05:49:31.763663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 248/526] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:31 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:31.931607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.935276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:31.944306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.945859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:31.955184 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d3fe2c1e-63fa-489f-a5ed-d3e416a5e6e7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.276697 Aug 24 05:49:31.956401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 279/527] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:31 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:32.132934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:32.133734 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:32.146718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.154241 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.160699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:32.161804 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.162488 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.163181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:32.440082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:32.449037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b7803e3a-7606-4f8b-84d9-a661e229e911 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1559 microversion: 2.1 time: 0.321258 Aug 24 05:49:32.449640 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 249/528] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:32 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1559 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:32.506814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:32.507792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:32.515506 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.516741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.517780 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:32.518496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.518982 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.519364 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:32.594081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:32.604868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-924850c3-84a4-422c-b0fc-3a95376d5a2d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1613 microversion: 2.1 time: 0.108132 Aug 24 05:49:32.605456 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 280/529] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:32 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1613 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:32.680073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:32.681056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:32.694109 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.694945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.695785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:32.697237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.697913 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.698555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:32.769491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:32.770115 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:32.778634 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.779433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.780034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:32.780932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:32.782001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:32.783290 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.013121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.030779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-223b8d8a-c596-4ba3-9f35-91404aca62df tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.353272 Aug 24 05:49:33.046429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 250/530] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:32 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:33.046429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:33.046429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:33.069825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.070718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.072058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.073790 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.074284 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.075424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.115780 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.127870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0596b848-480d-4570-8c8a-12eecb33c944 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.362021 Aug 24 05:49:33.140964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 281/531] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:32 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:33.472337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:33.473074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:33.480861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.491259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.491259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.491259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.491259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.491706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.538894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.548037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.562927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.567260 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5cd29185-d9b6-4d6d-a8be-eaca1095c3b9 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.532445 Aug 24 05:49:33.570228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 251/532] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:33 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:33.627757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:33.628873 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:33.640493 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.641069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.642073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.643889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:33.647813 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:33.648502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:33.695681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.706072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-22b61a53-e14e-4073-8cd2-2a6b07cb5bdc tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.237223 Aug 24 05:49:33.713934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 282/533] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:33 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:33.776578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:33.792801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-20b93974-4ff6-4858-bb65-9bcb6c63d1d5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1326 microversion: 2.1 time: 0.170249 Aug 24 05:49:33.795469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 252/534] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:33 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:34.061918 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:34.062360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:34.069724 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.070204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.070638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.071318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.071759 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.072173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.156462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:34.157357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:34.169246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.170107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.170933 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.171805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.172401 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.172985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.295215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.305012 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3a974103-2c50-4e9c-b92d-3c55836f887c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.246991 Aug 24 05:49:34.306496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 283/535] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:34 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:34.348937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.357965 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-67e1dca1-ba7f-45c0-b898-1a17b3e3fa7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.205379 Aug 24 05:49:34.359465 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 253/536] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:34 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:34.598982 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:34.599586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:34.605542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.606048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.606482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.607174 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.607629 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.608046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.729806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:34.734714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:34.739985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.745103 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.745670 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.752075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.752651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.753275 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.753906 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.763865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.765292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.766543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-06288287-8102-480f-a06f-983f90935821 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.172375 Aug 24 05:49:34.769952 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 284/537] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:34 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:34.820533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:34.821235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:34.828919 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.830041 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.830652 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.831488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:34.832101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:34.832987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:34.908492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.917692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9e183238-c780-4a2a-ba27-f54beedb42db tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1326 microversion: 2.1 time: 0.101455 Aug 24 05:49:34.926027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:34.933895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 285/538] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:34 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:34.936237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d4399220-d82f-4574-95d4-773e19d121be tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.210263 Aug 24 05:49:34.936815 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 254/539] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:34 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:35.327182 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:35.327813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:35.340400 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.340886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.352631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.352631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.352631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.352631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.380040 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:35.382462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:35.394091 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.394575 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.395010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.395707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.396147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.396565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.446286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:35.541261 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:35.551046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-310f903d-54bb-4175-9dc0-b34f4c3c078a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.227536 Aug 24 05:49:35.551867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 286/540] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:35 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:35.592863 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:35.601627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-50630673-874d-4f78-bf4d-79482f3805e1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.225472 Aug 24 05:49:35.602245 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 255/541] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:35 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:35.791120 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:35.791859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:35.797991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.798550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.799060 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.799826 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.800349 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.800852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.940424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:35.941984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:35.948226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.948789 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.949414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.950112 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:35.950634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:35.951047 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:35.951175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:35.965867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:35.969204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:35.972447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c293ca85-6b66-4e37-8434-ccfd65a2fa45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.184798 Aug 24 05:49:35.986248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 287/542] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:35 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:36.003030 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:36.003962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:36.014267 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.014776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.015211 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.015926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.016377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.016836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.041850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:36.051338 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4ea4b5a5-10d7-4afc-930e-4409851b320c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1326 microversion: 2.1 time: 0.114679 Aug 24 05:49:36.052220 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 256/543] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:35 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:36.166781 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:36.175713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0368e428-2508-4f7e-b9cf-6deb5ff64780 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.187557 Aug 24 05:49:36.177015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 288/544] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:35 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:36.572109 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:36.572899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:36.579564 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.580122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.580622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.581603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.582164 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.582684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.624737 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:36.628329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:36.640902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.642547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.643241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.644371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:36.645080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:36.645773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:36.729051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:36.738881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9e8b93aa-cae1-4465-864d-cef797259894 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.170553 Aug 24 05:49:36.739846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 257/545] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:36 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:36.819780 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:36.827619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-77dc4f62-6ded-45a0-b60a-f1e6c565e4c6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.208866 Aug 24 05:49:36.828113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 289/546] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:36 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:37.005936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:37.007066 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:37.012521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.013005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.013469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.014200 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.014655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.015079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.074540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:37.075154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:37.082379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.083178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.083817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.084907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.085356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.085799 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.156318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:37.164943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-646df999-1033-43bf-a90c-a9d25dee59a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1326 microversion: 2.1 time: 0.095902 Aug 24 05:49:37.175338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 290/547] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:37 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:37.176229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:37.185603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:37.187406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:37.188678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a294f95f-929c-44f9-a66f-a9c528d89e1d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.186725 Aug 24 05:49:37.189661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 258/548] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:37 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:37.198842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:37.199744 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:37.207227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.207834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.208349 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.209114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.209696 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.210159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.351454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:37.359492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6db32816-fcb3-42d7-9220-48cfcca36fb8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.164551 Aug 24 05:49:37.360048 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 291/549] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:37 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:37.759976 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:37.760590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:37.768711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.769297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.769879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.770627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.771087 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.771642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.849297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:37.849995 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:37.863107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.863851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.864289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.864996 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:37.865454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:37.865903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:37.915088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:37.923824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5cee0671-364f-4576-8e79-90916482f8a2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.167105 Aug 24 05:49:37.924692 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 259/550] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:37 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:38.013405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.021638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-be88569b-92b1-4ea9-89b5-23b6ae5a17db tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.177119 Aug 24 05:49:38.022295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 292/551] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:37 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:38.187170 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:38.187724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:38.194005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.194489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.194929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.195632 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.196081 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.196503 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.214899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:38.215466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:38.222891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.223380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.223818 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.224533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.224991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.225415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.275304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.283133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9ef4b9c9-3cf0-4012-895e-20fcced657cd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1326 microversion: 2.1 time: 0.101395 Aug 24 05:49:38.283909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 260/552] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:38 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:38.388414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:38.389153 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:38.392964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.396425 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.396917 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.397357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.398085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.398537 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.398952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.402448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.404034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.405200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ce550012-c95e-4e8f-8ddb-33a6323c16dc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.194498 Aug 24 05:49:38.405793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 293/553] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:38 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:38.528683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:38.536896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2608af53-4b34-445c-877b-2cf23778485b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.152909 Aug 24 05:49:38.537457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 261/554] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:38 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:38.944557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:38.945156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:38.951415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.951884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.952308 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:38.952988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:38.953431 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:38.953868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.042162 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:39.042781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:39.049638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.050122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.050559 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.051304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.051760 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.052192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.081364 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.088988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-54f0a5c5-3402-47b1-b3fc-34337f1a8951 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.148293 Aug 24 05:49:39.089556 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 294/555] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:38 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:39.186837 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.195701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fc87776c-aeaf-46f8-8a63-7a80ac3f58a5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.157306 Aug 24 05:49:39.196328 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 262/556] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:39 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:39.304247 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:39.304863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:39.311082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.311558 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.311988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.312667 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.313115 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.314068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.373886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.382358 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3826ccba-6b58-4c62-8eef-cc8c1a7055ac tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1326 microversion: 2.1 time: 0.082181 Aug 24 05:49:39.382928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 295/557] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:39 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1326 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:39.428661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:39.429335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:39.435355 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.435832 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.436267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.436955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.437434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.437888 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.558415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:39.559049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:39.562998 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.565621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.566103 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.566535 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.567235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:39.567683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:39.568100 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:39.572314 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.573876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.575052 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-192ee374-7aae-4255-aa12-e79e008c0c45 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.150304 Aug 24 05:49:39.575806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 263/558] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:39 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:39.586498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=100 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:39.700923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:39.708546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3174735a-2a6a-46b5-aa30-f6d6296ae75b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.154139 Aug 24 05:49:39.709114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 296/559] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:39 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:40.109142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.109701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.116156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.116636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.117068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.117786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.118237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.118656 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.216155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.216797 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.225016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.225503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.226294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.227003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.227461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.227884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.248363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.256246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-19db73e4-8be6-44e6-897e-54c06098f3c2 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.151202 Aug 24 05:49:40.257047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 264/560] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:40.361360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.368962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4bcc592d-eef6-4491-98ea-0aa1f719318b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.156679 Aug 24 05:49:40.369529 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 297/561] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:40.402885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.403496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.410218 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.410699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.411136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.411828 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.412276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.412700 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.472495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.480073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-13084237-d67e-406a-84e8-00137884832f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1326 microversion: 2.1 time: 0.081107 Aug 24 05:49:40.480645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 265/562] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1326 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:40.597541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.598181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.604107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.604592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.605027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.606119 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.606236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.606715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.729363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:40.730231 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:40.736601 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.737083 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.737520 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.738247 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:40.738695 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:40.739799 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:40.756433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.765755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.767949 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.769094 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dcf30e89-5237-45a1-9788-39d7add29dcd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.175410 Aug 24 05:49:40.769672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 298/563] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:40.881983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:40.890128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4f06c765-1059-4ba0-9018-b0d64411a54e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.164535 Aug 24 05:49:40.890728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 266/564] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:40 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:41.276634 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:41.277256 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:41.284260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.284741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.285168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.285890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.286348 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.286775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.388738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:41.389381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:41.395801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.396289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.396728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.397423 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.397900 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.398324 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.421681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:41.430344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b7f219f4-68f3-4b6f-b636-8f857f7c5a13 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.157467 Aug 24 05:49:41.430860 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 299/565] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:41 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:41.500122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:41.500764 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:41.506621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.507095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.507543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.508229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.508679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.509098 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.526393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:41.535145 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bf559dcb-a4a9-4328-a540-2ce39b9dfa1c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.150173 Aug 24 05:49:41.535723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 267/566] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:41 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:41.540271 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.540754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.541186 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.541656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lazy-loading 'fault' on Instance uuid 2bfde071-16a2-4288-aec1-6d38bb343db6 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:49:41.583488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:41.591017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dd6f3f56-a07e-465a-9896-d8a727650886 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 200 len: 1331 microversion: 2.1 time: 0.094719 Aug 24 05:49:41.591581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 300/567] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:41 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:41.792073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:41.792606 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:41.798806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.799295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.799726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.800414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.800868 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.801290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.912317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:41.912935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:41.919236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.919731 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.920166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:41.920870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:41.921334 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:41.921966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.069614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:42.077725 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-037a9725-385e-46f8-ad58-32c15ce95707 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.169971 Aug 24 05:49:42.078313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 301/568] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:41 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:42.321010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:42.330376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:42.331896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:42.333057 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c8e92773-b327-4a6a-b71e-e3056c2d283c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.544956 Aug 24 05:49:42.333625 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 268/569] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:41 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:42.451619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:42.452233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:42.458997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:42.459481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:42.459914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.460602 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:42.461053 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:42.461477 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.555464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:42.556782 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:42.563164 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:42.564300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:42.564968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.565881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:42.566338 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:42.566756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.591808 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:42.600322 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-68da9874-fce5-4d84-be24-c0a360f3758d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.152163 Aug 24 05:49:42.603259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 302/570] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:42 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:42.613075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:42.613787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:42.620563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:42.621040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:42.621476 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.622185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:42.622631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:42.623047 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:42.636961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 HTTP/1.1 Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:49:42.638892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:49:42.640401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '2bfde071-16a2-4288-aec1-6d38bb343db6'} Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:49:42.641405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:49:42.643392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:42.644833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:49:42.644833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8f7337bd-1c7a-4a45-aae9-aea1cd6c190c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 404 len: 111 microversion: 2.1 time: 0.032074 Aug 24 05:49:42.644833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 303/571] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:42 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:49:42.650282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d097617c-cf4e-442a-b3bd-370795f873e1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '.version_select at 0x7fa91c3d4430>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:42.663741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:42.673896 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d097617c-cf4e-442a-b3bd-370795f873e1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415609316" status: 202 len: 0 microversion: 2.1 time: 0.027133 Aug 24 05:49:42.674986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 304/572] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 05:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415609316 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:49:42.902824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:42.911293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-72a176f9-0289-48c5-8511-6c28fa8c6db0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.359560 Aug 24 05:49:42.911969 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 269/573] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:42 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:43.100192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:43.100814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:43.107818 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.108312 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.109040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.109797 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.110280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.111189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.246280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:43.260941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1997ba43-9682-42da-a16f-bd224ee195b3 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1513 microversion: 2.1 time: 0.164654 Aug 24 05:49:43.261523 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 305/574] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:43 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:43.355885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:43.356560 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:43.363610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.364083 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.364604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.365237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.365722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.366135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.445873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2ae9736-2a15-4840-95b3-09d61b94207d"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:43.448312 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:43.454324 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.454889 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.455214 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.455926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.456367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.456987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.625745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:43.637051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:43.638846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:43.640489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6d36d1a5-41cf-4392-bf9b-0fefffb065e6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.288666 Aug 24 05:49:43.641125 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 270/575] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:43 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:43.645539 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-02f8b814-6abe-4c6b-a216-ce810aad1d4d req-236891ae-95d7-4ee7-88bc-7afeb8904ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f", "name": "network-vif-deleted", "tag": "c03ff667-2411-4f7e-bb83-efebc24e1067"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:43.655821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-02f8b814-6abe-4c6b-a216-ce810aad1d4d req-236891ae-95d7-4ee7-88bc-7afeb8904ff2 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.656297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-02f8b814-6abe-4c6b-a216-ce810aad1d4d req-236891ae-95d7-4ee7-88bc-7afeb8904ff2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.656729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-02f8b814-6abe-4c6b-a216-ce810aad1d4d req-236891ae-95d7-4ee7-88bc-7afeb8904ff2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.668331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-02f8b814-6abe-4c6b-a216-ce810aad1d4d req-236891ae-95d7-4ee7-88bc-7afeb8904ff2 service nova] Creating event network-vif-deleted:c03ff667-2411-4f7e-bb83-efebc24e1067 for instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f on hv-cinder-85426 Aug 24 05:49:43.674098 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-02f8b814-6abe-4c6b-a216-ce810aad1d4d req-236891ae-95d7-4ee7-88bc-7afeb8904ff2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030924 Aug 24 05:49:43.674554 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 271/576] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:43.679473 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:43.680165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:43.686129 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.686611 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.687048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.687744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.688196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.688655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.833732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:43.837283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:43.841953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-732e5bc5-5a70-44e4-9d82-6a8da26826dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1358 microversion: 2.1 time: 0.166307 Aug 24 05:49:43.842512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 272/577] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:43 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:43.847134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:43.847619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:43.854731 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.855205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.855631 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.856321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:43.856765 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:43.857179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:43.940274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lazy-loading 'services' on Instance uuid 0914a19f-ad14-4b39-84b5-dc7296adcf95 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:49:44.011529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-42aaebf0-856d-46eb-8c3d-8b3e6a3bc0ea tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments/915acc62-8e95-4a95-bd44-c6508560b165" status: 202 len: 0 microversion: 2.1 time: 0.167789 Aug 24 05:49:44.012111 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 273/578] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:49:43 2022] DELETE /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments/915acc62-8e95-4a95-bd44-c6508560b165 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:49:44.017087 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:44.017819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:44.023887 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.024363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.024793 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.025477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.025952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.026377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.158009 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:44.166913 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1c117682-f1ab-40d7-8e66-4010d202a6b6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.153692 Aug 24 05:49:44.167474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 274/579] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:44 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:44.172015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:44.174793 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:44.180778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.181261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.181734 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.182434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.182919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.183347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.217391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-99e009c7-b598-43f5-a62f-b577623478fa tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048853 Aug 24 05:49:44.217991 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 275/580] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:49:44 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:44.284351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:44.285092 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:44.296358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.297017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.297533 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.299253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.300205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.300902 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.378761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:44.386483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-34de6ee5-aab2-4b60-978d-df44f7ae8015 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 200 len: 1304 microversion: 2.1 time: 0.106536 Aug 24 05:49:44.387246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 276/581] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:44 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:44.426369 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b11b99e0-c4d0-42e5-a480-0cd5f2d9cc88 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.984493 Aug 24 05:49:44.426903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 306/582] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:49:43 2022] POST /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:49:44.664429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:44.665033 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:44.671468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.671947 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.672377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.673066 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.673515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.673963 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.804036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:44.812730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:44.814283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:44.815438 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b8d70f58-24b4-416b-990c-4d1e662c9d98 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.155000 Aug 24 05:49:44.816001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 277/583] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:44 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:44.864705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:44.865406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:44.871558 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.872037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.872475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:44.873161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:44.873651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:44.874121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.005468 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:45.013072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0b718e5d-e885-45f2-b397-3f138bb5ff64 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1547 microversion: 2.1 time: 0.153183 Aug 24 05:49:45.013651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 307/584] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:44 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:45.034249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.034984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:45.040946 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.041434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.041909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.042601 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.043090 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.043478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.187524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:45.188962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.189595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:45.197143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3811e6fc-9e70-4378-ac5c-ea5e63db6ace tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1547 microversion: 2.1 time: 0.166624 Aug 24 05:49:45.198021 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 278/585] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:45.198156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.198522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.199083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.199805 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.200256 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.200675 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.218644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.225808 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:45.226656 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Searching by: {'deleted': False, 'project_id': '3d5351c28cfa4491bfa37944aa187737'} {{(pid=127193) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 05:49:45.234300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.234896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.236133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.236950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.237531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.238072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.330968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.multi_cell_list [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127193) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 05:49:45.354218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:45.362756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-231cf012-650e-4264-9c87-2c897f7f1d61 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.178316 Aug 24 05:49:45.363332 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 308/586] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:45.367866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.370082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:45.376590 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.377076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.377503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.378216 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.378665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.379087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.408686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0f99cc5d-05d3-4bcb-9057-6939f444dcc2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Aug 24 05:49:45.409240 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 309/587] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:45.413550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.414183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:45.419710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.420184 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.420616 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.421298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.421782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.422204 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.429597 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-79f1c6e6-c431-4275-b356-03cc9b935e62 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214867 Aug 24 05:49:45.430196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 279/588] 10.222.0.73 () {58 vars in 1125 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:49:45.435966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] HTTP exception thrown: Instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f could not be found. Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Request method failure captured: Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f HTTP/1.1 Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbuc9Hntr-tFe5Wr0wSwI2AbhjxRmEbO2Fc-U_AF8YeGKgbtlaKtpZxbOO2J1hx8fX9XxcmdMOzycITGsVjl87MIC-4n2fEZgWTdKpy8Pxce-haDq_9ymrYKT7gUHvquAACXqpRUsd0y5DJqhhJgr2pAQjba39HqgPS1P3Zd5_MU-dw Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 87f7a45fce204c9c9c15fae64b26b61e Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesSnapshotTestJSON-601238525 Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:49:45.437635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesSnapshotTestJSON-601238525 Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 87f7a45fce204c9c9c15fae64b26b61e Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-601238525 Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesSnapshotTestJSON-601238525-project Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 8e9cefedd37f43e6bb64a270cde9f6b6 Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesSnapshotTestJSON-601238525-project Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f could not be found. Aug 24 05:49:45.440195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f'} Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f could not be found. Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:49:45.441116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f could not be found. Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f could not be found. Aug 24 05:49:45.442571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:49:45.443697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Returning 404 to user: Instance 4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:49:45.443697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7c2a20f8-4c93-4640-abf7-7e520a032c58 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f" status: 404 len: 111 microversion: 2.1 time: 0.029489 Aug 24 05:49:45.443697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 310/589] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers/4c9cd5e5-1cf8-4fb4-a79b-c861722e9b4f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:49:45.443930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.443930 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:45.450337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.450817 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.451408 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.452116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.452566 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.454411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.627818 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:45.636791 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-aeb988cf-dcf3-4de9-b02e-c7a7f96a50e6 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1547 microversion: 2.1 time: 0.199250 Aug 24 05:49:45.638013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 280/590] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1547 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:45.838540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:45.839321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:45.845683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.846168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.846604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.847346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:45.847753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:45.848174 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:45.998570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:46.008227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:46.009739 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:46.010877 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b8f84466-dbf5-4670-bb19-b533385f1943 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.176426 Aug 24 05:49:46.011429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 311/591] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:45 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:46.383192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:46.383795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:46.390150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.390619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.391058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.391775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.392221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.392689 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.420501 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:46.423435 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:46.429958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.430591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.431135 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.431871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.432411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.432838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.462058 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-df96edee-28d1-49e2-a619-b72942b6f367 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045455 Aug 24 05:49:46.462622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 312/592] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:49:46 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 05:49:46.526446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:46.526895 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:46.527036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:46.533415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.533936 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.534378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.535073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.535170 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-27664abc-ee95-4de9-9e81-58e3a1f39e7a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.155863 Aug 24 05:49:46.535528 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.535718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 281/593] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:46 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:46.535951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.560519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:49:46.563287 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:46.640867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8602869f-25fa-431a-af67-07775ce0a13b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 204 len: 0 microversion: 2.1 time: 0.118204 Aug 24 05:49:46.641665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 313/594] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:49:46 2022] DELETE /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:49:46.649780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:46.650421 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:46.656278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.656749 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.657733 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.658413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:46.658855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:46.659276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:46.788745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:46.796317 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c56e10a2-c1f9-489a-863a-9d220ff144ef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.150382 Aug 24 05:49:46.796879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 282/595] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:46 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:47.035165 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:47.035851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:47.042137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.042553 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.042984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.043658 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.044104 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.044521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.177141 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:47.185670 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:47.187180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:47.188330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-24cbfc62-fb20-4b62-ab0b-fa9e216e115e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.157970 Aug 24 05:49:47.188888 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 314/596] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:47 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:47.556264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:47.556901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:47.563770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.564253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.564685 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.565369 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.565844 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.566263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.700737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:47.708835 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-226b25e5-5682-41df-a86d-1588508d195b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.156387 Aug 24 05:49:47.709505 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 283/597] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:47 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:47.818648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:47.819260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:47.825231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.825747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.826188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.826881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:47.827326 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:47.827757 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:47.954955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:47.962526 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fc3e7895-c2e9-4ca6-a3a6-f9daba7787be tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.148793 Aug 24 05:49:47.963090 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 315/598] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:47 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:48.210975 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:48.211507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:48.217552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.218061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.218497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:48.219190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.220176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.220607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:48.356380 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:48.365217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:48.366815 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:48.367968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-caaabe3c-76e7-43f3-9ed4-12842f28bf7e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.160989 Aug 24 05:49:48.368527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 284/599] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:48 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:48.731165 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:48.731803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:48.738298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.738784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.739223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:48.739919 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.740371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.740796 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:48.881801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:48.889542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bae93c24-8477-416e-a117-d6fba5b60842 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.164290 Aug 24 05:49:48.890130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 316/600] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:48 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:48.988624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:48.989244 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:48.995592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.996063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.996489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:48.997172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:48.997638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:48.998056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:49.134498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:49.143904 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-68aa6da5-467b-49c8-af03-cb0b24a5ff53 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.159259 Aug 24 05:49:49.144475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 285/601] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:48 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:49.390701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:49.391450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:49.397648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:49.398134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:49.398559 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:49.399246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:49.399802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:49.400241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:49.530601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:49.539681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:49.541164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:49.542324 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b74e8814-e299-4168-9222-69ccbdb83083 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.155685 Aug 24 05:49:49.542882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 317/602] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:49 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:49.909801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:49.910421 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:49.916560 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:49.917045 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:49.917479 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:49.918198 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:49.918648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:49.919068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.052196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:50.059940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8dbabde4-2135-4c00-8b85-d5102273e3f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.154130 Aug 24 05:49:50.060501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 286/603] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:49 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:50.164503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:50.165123 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:50.172386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.173500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.174056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.174970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.175424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.175856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.316389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:50.324227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bfd50a59-4c64-4910-b482-ec623c5dcb88 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.163661 Aug 24 05:49:50.324813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 318/604] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:50 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:50.343209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e64ffdee-248b-4d20-a80b-5c7ee31374af"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:50.346188 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:50.352164 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.352638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.353074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.353827 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.354279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.354732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.565926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:50.566440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:50.572299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.572771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.573193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.573890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:50.574337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:50.574751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:50.703269 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:50.712243 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:50.713791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:50.714950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2ee10560-113a-4d5c-8b86-f1695ff8f0f2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.153528 Aug 24 05:49:50.715528 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 319/605] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:50 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:51.082530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:51.083657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:51.091237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.091715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.092146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.092838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.093281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.093807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.250068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:51.257899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-551025cc-62ce-4d45-b100-725eda05eac2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.180171 Aug 24 05:49:51.258583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 320/606] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:51 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:51.346655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:51.347179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:51.353268 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.353798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.354231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.354941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.355393 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.355824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.493083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:51.502474 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4d6c601f-7dcd-4079-858f-9964d09fef7f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.160445 Aug 24 05:49:51.503062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 321/607] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:51 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:51.738013 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:51.738518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:51.744463 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.744943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.745379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.746107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:51.746562 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:51.746986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:51.876907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:51.886601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:51.888145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:51.889303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6826a893-810c-4ccb-93de-3c34ca9cae9e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.155627 Aug 24 05:49:51.889897 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 322/608] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:51 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:52.278354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:52.278955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:52.285310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.285813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.286238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:52.286909 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.287428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.287842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:52.421047 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:52.430231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-24952573-203c-4abb-b61d-16a45135aa42 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.155647 Aug 24 05:49:52.430817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 323/609] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:52 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:52.522937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:52.523468 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:52.529313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.529818 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.530251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:52.530940 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.531376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.531793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:52.660623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:52.668216 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d6e9e44f-dda6-4973-b507-8b3ca2160bb2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.149165 Aug 24 05:49:52.668785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 324/610] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:52 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:52.913167 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:52.913815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:52.919676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.920155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.920588 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:52.921266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:52.921760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:52.922184 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:53.051831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:53.060246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:53.061767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:53.062904 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a614002f-66d0-417f-af01-a22063ef95bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.153655 Aug 24 05:49:53.064089 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 325/611] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:52 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:53.458836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:53.459464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:53.465898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:53.466371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:53.466799 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:53.467481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:53.467927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:53.468368 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:53.601360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:53.609183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-da346004-8f8d-4518-b469-93ec341ac2b5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.154447 Aug 24 05:49:53.609785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 326/612] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:53 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:53.689834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:53.690448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:53.696299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:53.696780 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:53.697213 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:53.697932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:53.698388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:53.698812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:53.827634 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:53.835969 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bd340048-ed67-4e7f-8fb5-7682bcf56f61 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.150032 Aug 24 05:49:53.836541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 327/613] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:53 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:54.086569 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:54.086875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:54.094165 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.094678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.095111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:54.095803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.096259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.096697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:54.228494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:54.231929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:54.238432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:54.239954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:54.241086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-911ad0c2-6d4e-479f-b32b-20131fcc3687 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.158999 Aug 24 05:49:54.241656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 328/614] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:54 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:49:54.458970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1058606214", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "networks": [{"uuid": "0e5c96db-5fec-41fc-ba80-01fd385351d8"}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:54.513422 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] validate_networks() for [('0e5c96db-5fec-41fc-ba80-01fd385351d8', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:49:54.850825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:49:54.851243 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:49:54.851713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:49:54.852160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:49:54.852729 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:49:54.862003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.862487 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.862920 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:54.863644 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.864103 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.864519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:54.881363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Getting quotas for project 87f7a45fce204c9c9c15fae64b26b61e. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:54.887123 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Getting quotas for user 8e9cefedd37f43e6bb64a270cde9f6b6 and project 87f7a45fce204c9c9c15fae64b26b61e. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:54.898563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:49:54.902148 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:49:54.948884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c5ae73db-0dcd-4797-a509-78a3487fd82c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494564 Aug 24 05:49:54.949917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 329/615] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 05:49:54.955146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:54.955842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:54.961817 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.962289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.962723 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:54.963415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:54.963872 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:54.964292 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:55.179901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:55.189283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f8bd0641-9a3a-4729-a738-9ec4912dec9b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.237651 Aug 24 05:49:55.190128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 330/616] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:54 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:55.194562 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:55.195171 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:55.201172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:55.201770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:55.202306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:55.202914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:55.203452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:55.204418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:55.228198 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:55.263127 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3d637315-35f1-4c27-830c-923fbf4a179a tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.923539 Aug 24 05:49:55.264411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 287/617] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:49:50 2022] POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments => generated 194 bytes in 4926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:55.283518 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9d3bd2e0-ae78-49fe-bad2-f6467973262e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:55.284216 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9d3bd2e0-ae78-49fe-bad2-f6467973262e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:55.318855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:55.388734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:55.395223 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9d3bd2e0-ae78-49fe-bad2-f6467973262e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:55.402933 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9d3bd2e0-ae78-49fe-bad2-f6467973262e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1219 microversion: 2.1 time: 0.136759 Aug 24 05:49:55.403842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 288/618] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:55 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:55.406473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9ccacf84-9af5-4861-91da-aac6ca1315fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1682 microversion: 2.1 time: 0.214643 Aug 24 05:49:55.415489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-3d62c393-0bb2-48ee-833c-6cd9a03b2063 req-9a3013d0-01a3-4888-a154-feaac9e4b850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0914a19f-ad14-4b39-84b5-dc7296adcf95", "name": "network-vif-unplugged", "status": "completed", "tag": "0e532727-0ead-446a-aabc-351f29073b6f"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:55.418809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 331/619] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:55 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:55.431647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3d62c393-0bb2-48ee-833c-6cd9a03b2063 req-9a3013d0-01a3-4888-a154-feaac9e4b850 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:55.431985 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:55.432265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3d62c393-0bb2-48ee-833c-6cd9a03b2063 req-9a3013d0-01a3-4888-a154-feaac9e4b850 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:55.432700 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3d62c393-0bb2-48ee-833c-6cd9a03b2063 req-9a3013d0-01a3-4888-a154-feaac9e4b850 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:55.432870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:55.441118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:55.441712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:55.442228 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:55.442984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:55.443510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:55.443942 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:55.459384 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-3d62c393-0bb2-48ee-833c-6cd9a03b2063 req-9a3013d0-01a3-4888-a154-feaac9e4b850 service nova] Creating event network-vif-unplugged:0e532727-0ead-446a-aabc-351f29073b6f for instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 on hv-cinder-85426 Aug 24 05:49:55.487623 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-3d62c393-0bb2-48ee-833c-6cd9a03b2063 req-9a3013d0-01a3-4888-a154-feaac9e4b850 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082263 Aug 24 05:49:55.490415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 289/620] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:55.618410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:55.627368 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:55.628914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:55.630138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3620fc3e-4a68-4b08-914b-fcd9f45d6e08 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.204233 Aug 24 05:49:55.630731 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 332/621] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:55 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:56.214608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:56.215551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:56.222855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.223677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.224433 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.225438 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.225912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.226482 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.274762 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:56.277425 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:56.284022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.284500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.284923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.285637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.286083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.286491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.310343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lazy-loading 'flavor' on Instance uuid e9d74183-be9d-44b4-8b74-95591db6be75 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:49:56.468069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:56.498911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b4d35572-6dbf-4bc1-a4e8-631c116e8c8e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.287861 Aug 24 05:49:56.515554 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 290/622] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:56 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:56.522134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-2cd41c89-a6bf-472f-87ce-f41026576951 req-94e0fae4-ad65-49e5-9b23-53af5415b412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0914a19f-ad14-4b39-84b5-dc7296adcf95", "name": "network-vif-deleted", "tag": "0e532727-0ead-446a-aabc-351f29073b6f"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:56.522814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-89df7628-31b3-4146-a325-6f9bd95ab09c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/action" status: 200 len: 32 microversion: 2.1 time: 0.250169 Aug 24 05:49:56.529536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 333/623] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:49:56 2022] POST /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:49:56.534959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-2cd41c89-a6bf-472f-87ce-f41026576951 req-94e0fae4-ad65-49e5-9b23-53af5415b412 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.535810 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-2cd41c89-a6bf-472f-87ce-f41026576951 req-94e0fae4-ad65-49e5-9b23-53af5415b412 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.536498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-2cd41c89-a6bf-472f-87ce-f41026576951 req-94e0fae4-ad65-49e5-9b23-53af5415b412 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.545183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:56.547024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:56.553077 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-2cd41c89-a6bf-472f-87ce-f41026576951 req-94e0fae4-ad65-49e5-9b23-53af5415b412 service nova] Creating event network-vif-deleted:0e532727-0ead-446a-aabc-351f29073b6f for instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 on hv-cinder-85426 Aug 24 05:49:56.560412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-2cd41c89-a6bf-472f-87ce-f41026576951 req-94e0fae4-ad65-49e5-9b23-53af5415b412 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043037 Aug 24 05:49:56.562027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 291/624] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:56.566569 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.567064 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.567496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.567605 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:56.568229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.568332 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:56.574918 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.575101 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.575441 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.575856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.577850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.577850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.579732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.580411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.665610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:56.677523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6ad605c1-d9bc-42bc-8cdb-f2e65a2fae2a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 200 len: 1326 microversion: 2.1 time: 0.113992 Aug 24 05:49:56.678394 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 292/625] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:56 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:56.688111 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:56.689036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:56.701706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.702512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.703544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.707914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.708781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.710970 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.714391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:56.727101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-303b9518-f0bb-485f-bdac-1913b9723242 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1271 microversion: 2.1 time: 0.193591 Aug 24 05:49:56.737672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 334/626] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:56 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:56.737672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:56.737672 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:56.741983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.741983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.742490 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.743265 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:56.743793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:56.744290 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:56.901133 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:56.910269 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:56.911793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:56.912972 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-61303c7a-a6e6-4465-b7e5-e2c3a65560bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.183941 Aug 24 05:49:56.913540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 335/627] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:56 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:57.003640 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:57.011730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8bbedb2e-1dea-481e-a05a-8fbf7f7d7e51 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.328884 Aug 24 05:49:57.012290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 293/628] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:56 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:57.521931 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:57.523375 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:57.530355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.531182 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.531997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.533040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.534081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.534743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.605816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-4a43769d-8627-466b-922a-62897ff98297 req-e08f698e-20da-46ca-b0de-b390ad6f8414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d5dce2-87d9-41e2-87bd-e25ffdab7014", "name": "network-vif-plugged", "status": "completed", "tag": "837c49ba-3839-4640-af5d-797916aa3934"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:57.620521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:57.629547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4a43769d-8627-466b-922a-62897ff98297 req-e08f698e-20da-46ca-b0de-b390ad6f8414 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.632229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4a43769d-8627-466b-922a-62897ff98297 req-e08f698e-20da-46ca-b0de-b390ad6f8414 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.632951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4a43769d-8627-466b-922a-62897ff98297 req-e08f698e-20da-46ca-b0de-b390ad6f8414 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.652374 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-4a43769d-8627-466b-922a-62897ff98297 req-e08f698e-20da-46ca-b0de-b390ad6f8414 service nova] Creating event network-vif-plugged:837c49ba-3839-4640-af5d-797916aa3934 for instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 on hv-cinder-85426 Aug 24 05:49:57.661771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-4a43769d-8627-466b-922a-62897ff98297 req-e08f698e-20da-46ca-b0de-b390ad6f8414 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060419 Aug 24 05:49:57.664004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 294/629] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:49:57.709463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:57.712403 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:57.724160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.731726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.732527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.733831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.734506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.735329 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.754193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:57.767207 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7a6efa35-67a1-4628-87d2-693d104cc3d0 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.248245 Aug 24 05:49:57.768066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 336/630] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:57 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:57.769159 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 HTTP/1.1 Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:49:57.771195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:49:57.772698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '0914a19f-ad14-4b39-84b5-dc7296adcf95'} Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:49:57.773736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:49:57.775094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:49:57.776808 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:57.777508 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:57.777748 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:49:57.778802 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a8925323-152d-4775-84af-a82cced18821 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 404 len: 111 microversion: 2.1 time: 0.082200 Aug 24 05:49:57.779566 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 295/631] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:57 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:49:57.795245 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-866e490b-b175-4c99-8e73-30d57e45077f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '.version_select at 0x7fa91c1ee4c0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:57.796494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.797062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.798511 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.799481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.800127 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.800758 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.824474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-866e490b-b175-4c99-8e73-30d57e45077f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-290544723" status: 202 len: 0 microversion: 2.1 time: 0.034616 Aug 24 05:49:57.825724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 296/632] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 05:49:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-290544723 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:49:57.903915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:57.915729 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1e011bdc-5bbb-43a1-8028-e27d7a5ca5c5 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1277 microversion: 2.1 time: 0.143575 Aug 24 05:49:57.930338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 337/633] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:57 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:57.936301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:57.936948 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:57.949156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.950559 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.951004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:57.951716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:57.952624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:57.952792 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.033355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:58.034317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:58.053008 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.053786 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.055108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.058700 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.060117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.060776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.262546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:58.275048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:58.277051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:58.277762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a33e8e3a-8ce3-4259-8d12-4f1396cc4753 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.345436 Aug 24 05:49:58.278623 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 297/634] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:57 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:58.463160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:58.472181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-12fa3fda-8841-4d67-9cc7-731ce20f3bcf tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.443660 Aug 24 05:49:58.476950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 338/635] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:58 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:49:58.787337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:58.787957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:58.796016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.796469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.796907 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.798250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.798250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.798579 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.820444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5aa9e72f-a128-4e0d-9497-c6d036b2d165 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: .version_select at 0x7fa91c4ad3a0>, body: {"keypair": {"name": "tempest-keypair-1039505415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/6XdAok5qq5v78WiMWxa1gNo0Oj30WSSdNudoMuiC25ELs2R+RLBP0L27TbddmLNCk1I8KmHHZa8cnVAWkOUFUaDUcd99TLwH2M5xDn55OAVkWDcPzZoARtQREo+2r3A=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:58.836729 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5aa9e72f-a128-4e0d-9497-c6d036b2d165 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:49:58.840860 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5aa9e72f-a128-4e0d-9497-c6d036b2d165 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:49:58.855280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:49:58.866318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5aa9e72f-a128-4e0d-9497-c6d036b2d165 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053986 Aug 24 05:49:58.866922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 339/636] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:49:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:58.936189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:58.936807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:58.944635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.945331 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.946168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:58.947094 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:58.947575 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:58.948156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.091664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:59.100693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d46f89f9-3714-453b-b98a-7dddab55705a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.317080 Aug 24 05:49:59.102721 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 298/637] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:58 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:59.182959 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:59.200733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6b434259-77e4-4400-a844-65a252d3e243 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.266857 Aug 24 05:49:59.202053 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 340/638] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:58 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:49:59.300300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:59.301166 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:59.310735 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.317915 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.319189 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.320792 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.321497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.322843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.507553 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:49:59.508396 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:49:59.515224 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.516065 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.517495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.518670 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.519981 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.522909 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.586732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:59.597726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:59.599256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:59.600418 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2cba44e8-bb65-4be6-8047-1f3e8583f9bc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.304106 Aug 24 05:49:59.601472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 299/639] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:49:59 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:49:59.606014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-88e50223-a5c2-4c3a-8cf1-1aa75dbc3172 req-8d05d6e0-b333-4b09-a580-c9db9e67ff0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edba8161-3da6-49e5-a75f-00d7026681fc", "tag": "a6cdd57d-614e-49a2-9fa9-6c80e635376f"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:59.621444 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-88e50223-a5c2-4c3a-8cf1-1aa75dbc3172 req-8d05d6e0-b333-4b09-a580-c9db9e67ff0c service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.621979 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-88e50223-a5c2-4c3a-8cf1-1aa75dbc3172 req-8d05d6e0-b333-4b09-a580-c9db9e67ff0c service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.622420 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-88e50223-a5c2-4c3a-8cf1-1aa75dbc3172 req-8d05d6e0-b333-4b09-a580-c9db9e67ff0c service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.634693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-88e50223-a5c2-4c3a-8cf1-1aa75dbc3172 req-8d05d6e0-b333-4b09-a580-c9db9e67ff0c service nova] Creating event network-changed:a6cdd57d-614e-49a2-9fa9-6c80e635376f for instance edba8161-3da6-49e5-a75f-00d7026681fc on hv-cinder-85426 Aug 24 05:49:59.640196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-88e50223-a5c2-4c3a-8cf1-1aa75dbc3172 req-8d05d6e0-b333-4b09-a580-c9db9e67ff0c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037425 Aug 24 05:49:59.641788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 300/640] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:49:59.678608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-29ed3ac3-8261-4496-b1b5-d22756de9cd3 req-9d9d9b63-f713-4d1e-8c42-75409391156a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "977405bb-cdcc-4b20-b7ae-754ab660c7c3", "name": "network-vif-plugged", "status": "completed", "tag": "477bcaf5-dea4-412c-a5c0-a5d8080b11f0"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:49:59.688892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-29ed3ac3-8261-4496-b1b5-d22756de9cd3 req-9d9d9b63-f713-4d1e-8c42-75409391156a service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:49:59.689376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-29ed3ac3-8261-4496-b1b5-d22756de9cd3 req-9d9d9b63-f713-4d1e-8c42-75409391156a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:49:59.689832 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-29ed3ac3-8261-4496-b1b5-d22756de9cd3 req-9d9d9b63-f713-4d1e-8c42-75409391156a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:49:59.702280 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-29ed3ac3-8261-4496-b1b5-d22756de9cd3 req-9d9d9b63-f713-4d1e-8c42-75409391156a service nova] Creating event network-vif-plugged:477bcaf5-dea4-412c-a5c0-a5d8080b11f0 for instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 on hv-cinder-85426 Aug 24 05:49:59.707950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-29ed3ac3-8261-4496-b1b5-d22756de9cd3 req-9d9d9b63-f713-4d1e-8c42-75409391156a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034136 Aug 24 05:49:59.708572 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 301/641] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:49:59.760632 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:49:59.769250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8997a13b-7174-4c59-a308-9f5be86713a3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.266268 Aug 24 05:49:59.769856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 341/642] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:49:59 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:00.123639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:00.124285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:00.131818 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.132293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.132726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.133426 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.133906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.134329 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.222576 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:00.223741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:00.231778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.232266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.232697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.233869 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.234479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.235083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.307967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:00.323434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a4c31e97-8af5-40c9-9d02-8ccfc0b8dbbc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.203975 Aug 24 05:50:00.324141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 302/643] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:00 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:00.409991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:00.418529 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4f9c75cb-fc68-46bd-acd8-edcd09a350b8 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.199857 Aug 24 05:50:00.419143 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 342/644] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:00 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:00.467425 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-720512950", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7299e068-1622-4d4b-9084-04ba950ea9f9"}], "security_groups": [{"name": "tempest-securitygroup--1098507264"}], "key_name": "tempest-keypair-1039505415", "user_data": "}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:00.580046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] validate_networks() for [('7299e068-1622-4d4b-9084-04ba950ea9f9', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:50:00.628706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:00.629348 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:00.636229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.637130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.637768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.638903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.639610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.640200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.806401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:00.815761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:00.817525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:00.818908 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-42076703-e7e1-4382-9d67-667e74754a96 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1808 microversion: 2.20 time: 0.194580 Aug 24 05:50:00.833595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 343/645] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:00 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:00.833595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:00.833595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:00.837927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.838417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.839234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.840208 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:00.840688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:00.841110 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:00.987181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:00.996520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-30620418-6868-418c-99a0-816bcfde8790 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.175305 Aug 24 05:50:00.997398 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 344/646] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:00 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:01.083327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:50:01.083744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:50:01.084216 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:50:01.084737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:50:01.085320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:50:01.094048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.094581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.095180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.095902 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.096352 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.096770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.114786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:50:01.118724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:50:01.131313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:50:01.133608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:50:01.184051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1ce6f8e4-2901-443d-a262-63e6bcb3b237 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.720717 Aug 24 05:50:01.184607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 303/647] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:50:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:50:01.195755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-94ce9e79-aea9-4614-9ef9-bcc75690d32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:01.196440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-94ce9e79-aea9-4614-9ef9-bcc75690d32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:01.262164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-94ce9e79-aea9-4614-9ef9-bcc75690d32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:01.271231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-94ce9e79-aea9-4614-9ef9-bcc75690d32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1241 microversion: 2.1 time: 0.078844 Aug 24 05:50:01.272172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 345/648] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:01 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:01.343985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:01.344643 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:01.351529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.352020 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.352458 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.353223 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.353717 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.354147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.440446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:01.441156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:01.447317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.447870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.448360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.449161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.449714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.450195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.456398 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:01.516387 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:01.524751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6b77adca-6293-47b7-87ac-4b422c84b194 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.184510 Aug 24 05:50:01.525942 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 304/649] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:01 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:01.611399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:01.620891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-770bce12-da3a-435c-a912-14ff0e94da2d tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.184970 Aug 24 05:50:01.621771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 346/650] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:01 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:01.850530 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:01.851143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:01.857072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.857531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.857998 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.858939 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:01.859389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:01.859810 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:01.986268 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:01.994769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:01.996711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:01.997904 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5913e90c-d513-413e-a67b-176e529bbd78 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1795 microversion: 2.20 time: 0.151258 Aug 24 05:50:01.998463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 305/651] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:50:01 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1795 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:50:02.021042 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:02.021688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:02.027592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.028066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.028498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.029181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.029658 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.030079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.292323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:02.292943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:02.299869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.300354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.300788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.301487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.301975 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.302397 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.359599 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:02.368299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bc813442-d372-435d-93d1-09338bd9300f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.350964 Aug 24 05:50:02.368888 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 347/652] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:02 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:02.376133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:02.383784 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2ffe906a-041f-4120-adf5-da0ffa02b195 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1237 microversion: 2.1 time: 0.095802 Aug 24 05:50:02.384344 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 306/653] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:02 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:02.546583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:02.547108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:02.553062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.553537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.553988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.554663 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.555107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.555519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.643195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:02.643822 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:02.649834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.650321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.650759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.651461 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:02.651916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:02.652341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:02.685347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:02.693713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e5753e5a-e5de-40e5-a63e-f3bfa630887c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1260 microversion: 2.1 time: 0.150959 Aug 24 05:50:02.694302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 348/654] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:02 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:02.783212 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:02.790710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d0b556b1-bc23-480a-9a71-ffb85ed820a9 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.152427 Aug 24 05:50:02.791277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 307/655] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:02 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:03.389961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:03.390568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:03.397588 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.398081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.398530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.399676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.399676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.400221 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.405438 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:03.406351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:03.414828 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.415446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.415884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.416779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.417464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.418042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.487112 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:03.496561 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ceb51cee-366f-4057-b1b5-21e41a62f5fe tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1237 microversion: 2.1 time: 0.095034 Aug 24 05:50:03.497376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 308/656] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:03 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:03.545765 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:03.554435 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-02f39304-0eb8-4262-a546-8a5506061822 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.168434 Aug 24 05:50:03.555013 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 349/657] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:03 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:03.716257 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:03.717303 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:03.726968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.727499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.728098 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.728800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.729396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.729759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.811861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:03.812484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:03.819591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.820099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.820520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.821245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.821736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.822166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.872973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:03.881875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-cacba904-88e7-41c4-b913-35938c70ca91 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1445 microversion: 2.1 time: 0.171222 Aug 24 05:50:03.882457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 309/658] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:03 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:03.902370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:03.902984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:03.909591 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.910096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.910612 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.911408 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:03.911866 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:03.912293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:03.938668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:03.967024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:03.976082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8a380c67-858e-4e7b-912a-a40c08c8390c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.168049 Aug 24 05:50:03.976648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 350/659] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:03 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:04.054185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:04.061832 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e3ffed5b-3f4e-470e-9dbb-a06a0d3331d3 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1445 microversion: 2.1 time: 0.163164 Aug 24 05:50:04.062331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 310/660] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:03 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1445 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:04.518927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:04.519870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:04.527247 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:04.527731 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:04.528162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:04.528856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:04.529492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:04.529947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:04.579406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:04.580046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:04.586526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:04.587307 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:04.587843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:04.588547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:04.588996 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:04.589413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:04.623242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:04.632047 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8dbe1810-5d44-493a-9949-82d2490f0cb5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1293 microversion: 2.1 time: 0.117858 Aug 24 05:50:04.632624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 351/661] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:04 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:04.850504 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:04.858878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d1a24e6e-85bc-4e85-98d5-662a2e126404 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.284000 Aug 24 05:50:04.859453 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 311/662] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:04 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:04.997922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:04.998608 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:05.001185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:05.007109 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.007674 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.008295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.008988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.009613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.010850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.147579 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:05.159875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8b44fca1-38ba-4a54-9e39-30731912575e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.165872 Aug 24 05:50:05.160480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 352/663] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:04 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:05.657724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:05.658476 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:05.665983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.666472 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.666909 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.667619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.668068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.668493 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.786602 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:05.794180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-543621bb-32ae-4a58-afc2-084587e6f335 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1293 microversion: 2.1 time: 0.142496 Aug 24 05:50:05.794750 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 312/664] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:05 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1293 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:05.880464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:05.881076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:05.887542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.888056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.888727 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:05.889631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:05.890090 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:05.890513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.033997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:06.044829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bd541048-eb90-4433-93c8-8ebb5d75861c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.167875 Aug 24 05:50:06.056830 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 353/665] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:05 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:06.109322 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-b7fc5944-8a6b-4c3b-a0d5-b5874255d920 req-06bb90a5-84ef-4f5c-ad9e-4783b14e03db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977405bb-cdcc-4b20-b7ae-754ab660c7c3", "tag": "477bcaf5-dea4-412c-a5c0-a5d8080b11f0"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:06.121893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-b7fc5944-8a6b-4c3b-a0d5-b5874255d920 req-06bb90a5-84ef-4f5c-ad9e-4783b14e03db service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:06.122461 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-b7fc5944-8a6b-4c3b-a0d5-b5874255d920 req-06bb90a5-84ef-4f5c-ad9e-4783b14e03db service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:06.122922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-b7fc5944-8a6b-4c3b-a0d5-b5874255d920 req-06bb90a5-84ef-4f5c-ad9e-4783b14e03db service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.134515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-b7fc5944-8a6b-4c3b-a0d5-b5874255d920 req-06bb90a5-84ef-4f5c-ad9e-4783b14e03db service nova] Creating event network-changed:477bcaf5-dea4-412c-a5c0-a5d8080b11f0 for instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 on hv-cinder-85426 Aug 24 05:50:06.139459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-b7fc5944-8a6b-4c3b-a0d5-b5874255d920 req-06bb90a5-84ef-4f5c-ad9e-4783b14e03db service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 Aug 24 05:50:06.140045 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 313/666] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:50:06.182920 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:06.183500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:06.189543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:06.190059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:06.190499 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.191196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:06.191650 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:06.192075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.329356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:06.348807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5bc11a3d-cf20-4097-907d-8a42e9304d7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.170277 Aug 24 05:50:06.349402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 354/667] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:06 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:06.815755 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:06.817256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:06.841527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:06.842346 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:06.846342 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.847327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:06.847819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:06.848248 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:06.936963 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:06.947159 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-46362d25-8e2c-450a-b02b-05652a4b62f5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1293 microversion: 2.1 time: 0.135580 Aug 24 05:50:06.947746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 314/668] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:06 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:07.068676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:07.069379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:07.076452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.077272 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.077969 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.079577 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.080263 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.080904 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.288694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:07.301246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a46177f1-eb36-4e0f-9c90-8e17ad945e54 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.236519 Aug 24 05:50:07.302380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 355/669] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:07 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:07.372512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:07.373135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:07.385929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.385929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.385929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.385929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.386410 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.386410 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.394527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:07.395142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:07.402130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.402613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.403044 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.403739 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.404189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.404603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.550891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:07.559093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b648974b-84e4-405e-80b8-e060dea5fe14 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1593 microversion: 2.1 time: 0.169073 Aug 24 05:50:07.559674 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 356/670] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:07 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1593 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:07.566054 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-97c68878-b41c-4b6b-a135-7a06cdf6798d req-fed2e7b6-35ff-4a77-92d3-a0ad01412a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edba8161-3da6-49e5-a75f-00d7026681fc", "name": "network-vif-plugged", "status": "completed", "tag": "a6cdd57d-614e-49a2-9fa9-6c80e635376f"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:07.574557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-97c68878-b41c-4b6b-a135-7a06cdf6798d req-fed2e7b6-35ff-4a77-92d3-a0ad01412a3f service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.575033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-97c68878-b41c-4b6b-a135-7a06cdf6798d req-fed2e7b6-35ff-4a77-92d3-a0ad01412a3f service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.575459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-97c68878-b41c-4b6b-a135-7a06cdf6798d req-fed2e7b6-35ff-4a77-92d3-a0ad01412a3f service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.587482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-97c68878-b41c-4b6b-a135-7a06cdf6798d req-fed2e7b6-35ff-4a77-92d3-a0ad01412a3f service nova] Creating event network-vif-plugged:a6cdd57d-614e-49a2-9fa9-6c80e635376f for instance edba8161-3da6-49e5-a75f-00d7026681fc on hv-cinder-85426 Aug 24 05:50:07.592591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-97c68878-b41c-4b6b-a135-7a06cdf6798d req-fed2e7b6-35ff-4a77-92d3-a0ad01412a3f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 Aug 24 05:50:07.593431 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 357/671] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:07.816865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:07.825917 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-384a6342-c281-4d87-9d65-53be31a2fa37 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.458695 Aug 24 05:50:07.840300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 315/672] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:07 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:07.972316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:07.973080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:07.980253 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.980836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.981264 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:07.982233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:07.982889 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:07.983714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:08.061145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:08.072150 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-eb055168-e89f-42be-afa1-87255d09b424 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1299 microversion: 2.1 time: 0.104845 Aug 24 05:50:08.074329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 358/673] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:07 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:08.324162 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:08.324776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:08.331088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:08.331570 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:08.331997 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:08.332876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:08.333465 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:08.334062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:08.582890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:08.598849 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2f952bfd-a1ec-45da-b5a7-cd20c139b57d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.278444 Aug 24 05:50:08.600595 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 316/674] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:08 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:08.847856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:08.848775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:08.855101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:08.855538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:08.855973 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:08.856670 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:08.857121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:08.857541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.093859 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:09.094516 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:09.100694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:09.102529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.104070 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.104518 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.105230 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.106884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.107328 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.110563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ae60a263-f8b9-4aa4-ab65-7f1c38300810 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1319 microversion: 2.1 time: 0.266898 Aug 24 05:50:09.124353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 359/675] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:08 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:09.335177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:09.343328 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-172d4dd1-855d-4c68-8675-fe5d48c48d1a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.253051 Aug 24 05:50:09.357080 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 317/676] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:09 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:09.427125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-40000f94-cace-4766-9c93-6a2ac97f5792 req-541933e1-8f73-448a-b6c9-ff8ba7e1b4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ce9d76-06ce-40b3-91a3-ccf2af253a09", "tag": "a5494de2-9b32-433b-9632-7ff022a2fa4d"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:09.439873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-40000f94-cace-4766-9c93-6a2ac97f5792 req-541933e1-8f73-448a-b6c9-ff8ba7e1b4c4 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.441137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-40000f94-cace-4766-9c93-6a2ac97f5792 req-541933e1-8f73-448a-b6c9-ff8ba7e1b4c4 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.441801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-40000f94-cace-4766-9c93-6a2ac97f5792 req-541933e1-8f73-448a-b6c9-ff8ba7e1b4c4 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.457826 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-40000f94-cace-4766-9c93-6a2ac97f5792 req-541933e1-8f73-448a-b6c9-ff8ba7e1b4c4 service nova] Creating event network-changed:a5494de2-9b32-433b-9632-7ff022a2fa4d for instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 on hv-cinder-85426 Aug 24 05:50:09.464586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-40000f94-cace-4766-9c93-6a2ac97f5792 req-541933e1-8f73-448a-b6c9-ff8ba7e1b4c4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041862 Aug 24 05:50:09.465980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 360/677] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:09.621816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:09.622441 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:09.629689 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.631060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.631506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.632397 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.633496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.634015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.799403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-e77dca36-477a-417a-a691-88b118063ee3 req-17321a22-6930-4501-81b7-617e665ad7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a2e0976-7c32-4f6c-a456-66c19a291d92", "tag": "d1ec8ac2-e17b-4798-b8fc-fe46228d109e"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:09.809123 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e77dca36-477a-417a-a691-88b118063ee3 req-17321a22-6930-4501-81b7-617e665ad7c2 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:09.809751 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e77dca36-477a-417a-a691-88b118063ee3 req-17321a22-6930-4501-81b7-617e665ad7c2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:09.810239 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-e77dca36-477a-417a-a691-88b118063ee3 req-17321a22-6930-4501-81b7-617e665ad7c2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:09.822894 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-e77dca36-477a-417a-a691-88b118063ee3 req-17321a22-6930-4501-81b7-617e665ad7c2 service nova] Creating event network-changed:d1ec8ac2-e17b-4798-b8fc-fe46228d109e for instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 on hv-cinder-85426 Aug 24 05:50:09.827848 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-e77dca36-477a-417a-a691-88b118063ee3 req-17321a22-6930-4501-81b7-617e665ad7c2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Aug 24 05:50:09.829376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 361/678] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:09.893429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:09.903158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-771710d4-2bb5-4922-9045-27f197d28356 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.285296 Aug 24 05:50:09.904059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 318/679] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:09 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:10.133607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:10.139130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:10.156128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.156916 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.157715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.162261 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.163021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.163720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.369734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:10.373580 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:10.374407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:10.380626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d4ba1d99-1a2e-4b8a-9113-0c7ca89708bb tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1508 microversion: 2.1 time: 0.252079 Aug 24 05:50:10.381891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 362/680] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:10 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:10.388158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.388803 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.389354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.390259 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.390883 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.391396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.405382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dd3421f-5681-4e9d-bdd7-08ffeacbb621", "device": "/dev/sdb"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:10.411981 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:10.425627 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.426468 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.427075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.427794 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.428408 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.428983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.763740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:10.789237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-899e2eaf-51cb-44de-8b69-f3b1143cec50 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "POST /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.388411 Aug 24 05:50:10.790238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 363/681] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:50:10 2022] POST /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc/os-volume_attachments => generated 194 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:10.804859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-219008655"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:10.807034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:10.821190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.822218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.825935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.826847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:10.827469 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:10.829599 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:10.996590 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.network.security_group_api [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Adding security group 1156758b-697b-4b41-94de-4c4152c50031 to port a5494de2-9b32-433b-9632-7ff022a2fa4d Aug 24 05:50:11.040108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:11.048393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-38f2ce17-b0ec-4616-8219-8343bd2b37de tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.687190 Aug 24 05:50:11.048977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 319/682] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:10 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:11.053615 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:11.054418 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:11.060157 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:11.060638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:11.061065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:11.061943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:11.062593 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:11.063937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:11.103803 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:11.126511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=8 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:11.269448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=12 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:11.277040 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:11.286335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7811d13a-8d59-4333-ba8d-ae9742571c8a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.236156 Aug 24 05:50:11.287327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 320/683] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:11 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:11.609313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-21d0b51c-803b-4ae4-85e4-2e755ba68f12 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/action" status: 202 len: 0 microversion: 2.1 time: 0.817673 Aug 24 05:50:11.610580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 364/684] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:50:10 2022] POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:50:11.622097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:11.623278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:11.624809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-b23e12c1-68e7-4dba-8043-12d6e73ad129 req-cd72aa15-8f3f-43f5-8104-654df6a6716d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ce9d76-06ce-40b3-91a3-ccf2af253a09", "tag": "a5494de2-9b32-433b-9632-7ff022a2fa4d"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:11.633053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:11.633894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:11.634412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:11.635535 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:11.636141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:11.636712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:11.637917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b23e12c1-68e7-4dba-8043-12d6e73ad129 req-cd72aa15-8f3f-43f5-8104-654df6a6716d service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:11.639054 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b23e12c1-68e7-4dba-8043-12d6e73ad129 req-cd72aa15-8f3f-43f5-8104-654df6a6716d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:11.639681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b23e12c1-68e7-4dba-8043-12d6e73ad129 req-cd72aa15-8f3f-43f5-8104-654df6a6716d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:11.655405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-b23e12c1-68e7-4dba-8043-12d6e73ad129 req-cd72aa15-8f3f-43f5-8104-654df6a6716d service nova] Creating event network-changed:a5494de2-9b32-433b-9632-7ff022a2fa4d for instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 on hv-cinder-85426 Aug 24 05:50:11.674780 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-b23e12c1-68e7-4dba-8043-12d6e73ad129 req-cd72aa15-8f3f-43f5-8104-654df6a6716d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054688 Aug 24 05:50:11.678154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 365/685] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:50:11.933970 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:11.946232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ff641817-1a05-461b-8b5c-7ea1480abc08 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1757 microversion: 2.1 time: 0.330853 Aug 24 05:50:11.962037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 321/686] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:11 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1757 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:12.069708 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:12.070667 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:12.078071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:12.079076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:12.079374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:12.079910 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:12.080531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:12.080979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:12.216440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:12.224854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-00a0cec2-50f1-4d26-b80c-79d3e6d0e32d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.159471 Aug 24 05:50:12.225440 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 366/687] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:12 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:12.308510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:12.309116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:12.315174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:12.315672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:12.316122 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:12.316812 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:12.317254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:12.317727 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:12.446739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:12.455353 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9d85057f-b02d-4316-abb7-bef13739d7dd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.150726 Aug 24 05:50:12.455921 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 322/688] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:12 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:13.246874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:13.247484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:13.254882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:13.255376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:13.255811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:13.256516 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:13.256977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:13.257400 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:13.391263 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:13.398963 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a8683fe0-a529-4ad9-934f-36a83a2fa534 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.155913 Aug 24 05:50:13.399632 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 367/689] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:13 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:13.476406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:13.477018 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:13.483695 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:13.484177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:13.485419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:13.486143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:13.486593 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:13.487034 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:13.627983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:13.636709 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-66b1687c-1347-4e18-9f34-c29f89d28cde tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.164382 Aug 24 05:50:13.637277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 323/690] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:13 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:14.424162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:14.424719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:14.431519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:14.432003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:14.432439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:14.433129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:14.433600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:14.434026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:14.560217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:14.568406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-523efd18-310c-4bfe-b4d4-9f14f1b98ad2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.148227 Aug 24 05:50:14.568979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 368/691] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:14 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:14.659315 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:14.659962 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:14.666445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:14.666929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:14.667362 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:14.668059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:14.668511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:14.668938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:14.800251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:14.808659 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-47a1f7eb-b448-474a-8312-53dbc0003f60 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.153806 Aug 24 05:50:14.809239 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 324/692] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:14 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:15.373330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-2efd89e1-dc37-48dd-8378-7ecc116d73d7 req-f2d493b4-2323-4471-a477-cafb220a557b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a2e0976-7c32-4f6c-a456-66c19a291d92", "name": "network-vif-plugged", "status": "completed", "tag": "d1ec8ac2-e17b-4798-b8fc-fe46228d109e"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:15.385142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-2efd89e1-dc37-48dd-8378-7ecc116d73d7 req-f2d493b4-2323-4471-a477-cafb220a557b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:15.385988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-2efd89e1-dc37-48dd-8378-7ecc116d73d7 req-f2d493b4-2323-4471-a477-cafb220a557b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:15.386417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-2efd89e1-dc37-48dd-8378-7ecc116d73d7 req-f2d493b4-2323-4471-a477-cafb220a557b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:15.397367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-2efd89e1-dc37-48dd-8378-7ecc116d73d7 req-f2d493b4-2323-4471-a477-cafb220a557b service nova] Creating event network-vif-plugged:d1ec8ac2-e17b-4798-b8fc-fe46228d109e for instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 on hv-cinder-85426 Aug 24 05:50:15.402467 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-2efd89e1-dc37-48dd-8378-7ecc116d73d7 req-f2d493b4-2323-4471-a477-cafb220a557b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032800 Aug 24 05:50:15.403232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 369/693] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:15.589495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:15.590238 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:15.596495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:15.597058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:15.597595 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:15.598381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:15.598908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:15.599399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:15.765128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:15.772937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0856fab6-8e92-45a6-bb33-ffe41da4684b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.187302 Aug 24 05:50:15.773860 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 325/694] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:15 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:15.830598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:15.831289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:15.837893 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:15.838371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:15.838799 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:15.839483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:15.839932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:15.840350 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:15.973331 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:15.981480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d57f737f-1819-4300-b8ba-03935f538c05 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.155132 Aug 24 05:50:15.982075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 370/695] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:15 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:16.794138 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:16.794787 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:16.801191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:16.801714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:16.802153 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:16.802844 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:16.803298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:16.803724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:16.930655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:16.938795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4f3f0c97-943a-4df9-8876-b5b7efc5509b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.148516 Aug 24 05:50:16.939371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 326/696] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:16 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:17.003762 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:17.004372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:17.010664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:17.011143 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:17.011573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:17.012307 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:17.012706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:17.013125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:17.141976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:17.150128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d86d5838-78f5-4f7a-b70b-51ecce544da7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.150764 Aug 24 05:50:17.150690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 371/697] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:16 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:17.959727 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:17.960290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:17.966760 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:17.967238 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:17.967672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:17.968415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:17.969737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:17.969992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:18.101586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:18.104980 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:18.110457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a36bb98f-2bc6-48aa-a21c-dfd98d3a7120 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.154699 Aug 24 05:50:18.111020 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 327/698] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:17 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:18.170332 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:18.170938 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:18.177455 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:18.177983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:18.178416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:18.179101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:18.179550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:18.179971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:18.322510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:18.331814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-908efdfe-289f-402f-8203-892431706d0e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.165217 Aug 24 05:50:18.332435 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 372/699] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:18 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:19.130208 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:19.130855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:19.137339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:19.137847 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:19.138288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:19.138978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:19.139430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:19.139856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:19.269812 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:19.277708 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3daa0c1a-2553-447a-9c61-0d5003d31426 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1367 microversion: 2.1 time: 0.151263 Aug 24 05:50:19.278281 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 328/700] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:19 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:19.352203 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:19.352811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:19.359500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:19.359978 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:19.360804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:19.361166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:19.361680 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:19.362103 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:19.504232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:19.512576 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-444495ee-fea5-41fc-9eae-54371f0fa23d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.164296 Aug 24 05:50:19.513286 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 373/701] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:19 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:20.301726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:20.302462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:20.308816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.309301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.309760 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:20.311095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.312085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.313003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:20.451277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:20.459264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7266f70c-6d38-4f4f-8966-8b895e28706d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1556 microversion: 2.1 time: 0.162867 Aug 24 05:50:20.459843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 329/702] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:20 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:20.479832 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:20.480317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:20.487519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.488005 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.488445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:20.489137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.489638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.490073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:20.535192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:20.535838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:20.556245 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.556738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.557174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:20.557924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:20.558379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:20.558806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:20.595064 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dd17985f-ecba-4b14-bdce-a0e1c7f24e01 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118864 Aug 24 05:50:20.597605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 374/703] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:50:20 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:20.707278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:20.715764 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-13fbf9bc-244c-43d4-a3b1-cc1bf877eaa7 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.185604 Aug 24 05:50:20.716548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 330/704] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:20 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:21.536102 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-227fce7b-3d53-41ac-b011-33822d4ffb77 req-33ea5bb0-710c-41fc-aef2-08afee07ac19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a2e0976-7c32-4f6c-a456-66c19a291d92", "tag": "d1ec8ac2-e17b-4798-b8fc-fe46228d109e"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:21.545428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-227fce7b-3d53-41ac-b011-33822d4ffb77 req-33ea5bb0-710c-41fc-aef2-08afee07ac19 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:21.545935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-227fce7b-3d53-41ac-b011-33822d4ffb77 req-33ea5bb0-710c-41fc-aef2-08afee07ac19 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:21.546369 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-227fce7b-3d53-41ac-b011-33822d4ffb77 req-33ea5bb0-710c-41fc-aef2-08afee07ac19 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:21.558783 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-227fce7b-3d53-41ac-b011-33822d4ffb77 req-33ea5bb0-710c-41fc-aef2-08afee07ac19 service nova] Creating event network-changed:d1ec8ac2-e17b-4798-b8fc-fe46228d109e for instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 on hv-cinder-85426 Aug 24 05:50:21.564623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-227fce7b-3d53-41ac-b011-33822d4ffb77 req-33ea5bb0-710c-41fc-aef2-08afee07ac19 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032651 Aug 24 05:50:21.565374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 375/705] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:21.738876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:21.739475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:21.746214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:21.746555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:21.747004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:21.747694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:21.748149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:21.748571 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:21.886567 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:21.894954 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-273d00e5-a292-48fe-b86b-9b269409339f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.160400 Aug 24 05:50:21.895495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 331/706] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:21 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:22.917154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:22.917815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:22.924927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:22.925406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:22.925892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:22.926573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:22.927025 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:22.927448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:23.054485 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:23.063374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b110fbae-3cbe-485d-893d-334010acde81 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.150546 Aug 24 05:50:23.063945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 376/707] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:22 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:24.084767 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:24.085392 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:24.092167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:24.092706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:24.093187 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:24.094038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:24.094574 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:24.094984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:24.311649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:24.320443 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3513a607-970d-492e-82cb-73bd191f44bc tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1735 microversion: 2.1 time: 0.239486 Aug 24 05:50:24.321194 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 332/708] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:24 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:25.342479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:25.343075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:25.350088 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.350561 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.350987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.351665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.352109 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.352525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.481814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:25.490114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-84230917-c666-4529-b021-e04771d98923 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1715 microversion: 2.1 time: 0.151522 Aug 24 05:50:25.490681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 377/709] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:25 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:25.596736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:25.597289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:25.604299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.604789 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.605226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.605962 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.606417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.606843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.694058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] HTTP exception thrown: Cannot 'detach_volume' instance e9d74183-be9d-44b4-8b74-95591db6be75 while it is in vm_state rescued Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Request method failure captured: Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments/c2ae9736-2a15-4840-95b3-09d61b94207d HTTP/1.1 Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsdP7Q-t8JRnuv4BFU0EFKbt_HtrMXv561NX0UrC6t-iBOAcNLf5m4dhrd4VtGj3WNb3JuuyIrLxJC09Afr6RfY3LKXcmcuolAwf26AfOMVx8jQxsuDTZYMf7rtd4_ZRgZ8V6YAidgJ7qvXt3Re-KaPSji-ET6Pzsg3lCvUveQavBk Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:50:25.695653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3726a58288d9455b97e041a2e92f8850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 3d8467cc62d948038690af1fdf5bb96a Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:50:25.697217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Cannot 'detach_volume' instance e9d74183-be9d-44b4-8b74-95591db6be75 while it is in vm_state rescued Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'server_id': 'e9d74183-be9d-44b4-8b74-95591db6be75', 'id': 'c2ae9736-2a15-4840-95b3-09d61b94207d'} Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e9d74183-be9d-44b4-8b74-95591db6be75 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:50:25.698065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e9d74183-be9d-44b4-8b74-95591db6be75 while it is in vm_state rescued Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e9d74183-be9d-44b4-8b74-95591db6be75 while it is in vm_state rescued Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:50:25.699711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Returning 409 to user: Cannot 'detach_volume' instance e9d74183-be9d-44b4-8b74-95591db6be75 while it is in vm_state rescued {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:50:25.701039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ab545009-e01a-4d10-8233-823583157eed tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments/c2ae9736-2a15-4840-95b3-09d61b94207d" status: 409 len: 152 microversion: 2.1 time: 0.104329 Aug 24 05:50:25.701039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 333/710] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:50:25 2022] DELETE /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments/c2ae9736-2a15-4840-95b3-09d61b94207d => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:50:25.707519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:25.708058 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:25.714647 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.715133 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.715643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.716489 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.716975 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.717448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.784881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1e6209f2-4eed-49f4-b61a-f3967bb99725 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "POST /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/action" status: 202 len: 0 microversion: 2.1 time: 0.082024 Aug 24 05:50:25.788500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 378/711] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:50:25 2022] POST /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:50:25.793606 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:25.794232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:25.800300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.800779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.801213 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.801943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:25.802430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:25.802855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:25.931368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:25.940329 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bbce2f21-1506-44cf-a817-5e4ce3eab26c tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1723 microversion: 2.1 time: 0.150496 Aug 24 05:50:25.940872 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 334/712] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:25 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:26.961689 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:26.962273 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:26.969373 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:26.969880 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:26.970312 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:26.971008 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:26.971458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:26.971882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:27.099991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:27.108067 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-408841d9-c003-42a0-9135-1deaa05e26cd tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1723 microversion: 2.1 time: 0.150738 Aug 24 05:50:27.108899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 379/713] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:26 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:28.129345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:28.129985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:28.131984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:28.137051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:28.137520 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:28.138005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:28.138689 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:28.139133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:28.139549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:28.302229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:28.310274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6a2db4f9-e14f-4424-8151-9c43d53e89c0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1723 microversion: 2.1 time: 0.184739 Aug 24 05:50:28.310831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 335/714] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:28 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:29.332122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:29.332813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:29.335229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=83 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:29.340424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:29.340914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:29.341362 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:29.342079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:29.342532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:29.342960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:29.475904 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:29.484358 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-76542457-a88c-4f3e-afee-4ccaf824bab5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1723 microversion: 2.1 time: 0.157004 Aug 24 05:50:29.484930 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 380/715] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:29 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:30.505530 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:30.506102 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:30.512462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:30.512941 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:30.513373 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:30.514088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:30.514537 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:30.514959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:30.649000 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:30.658706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8bae01ec-8156-4793-81e4-7fc390a4d91d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1723 microversion: 2.1 time: 0.157079 Aug 24 05:50:30.659511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 336/716] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:30 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:31.679299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:31.679905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:31.686504 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:31.687482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:31.687910 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:31.688592 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:31.689042 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:31.689459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:31.822383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:31.825847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:31.832504 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-81c295d4-d3f5-402b-8cdd-dbd9ba5fb158 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1723 microversion: 2.1 time: 0.157029 Aug 24 05:50:31.833079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 381/717] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:31 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:32.342949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:32.344002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:32.350446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:32.350928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:32.351366 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:32.352057 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:32.352505 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:32.352924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:32.433074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lazy-loading 'services' on Instance uuid edba8161-3da6-49e5-a75f-00d7026681fc {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:50:32.510857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d73a413c-0b0e-4b82-87d9-1a47f6b0605c tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "DELETE /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc/os-volume_attachments/8dd3421f-5681-4e9d-bdd7-08ffeacbb621" status: 202 len: 0 microversion: 2.1 time: 0.171629 Aug 24 05:50:32.511745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 337/718] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:50:32 2022] DELETE /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc/os-volume_attachments/8dd3421f-5681-4e9d-bdd7-08ffeacbb621 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:50:32.854038 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:32.854684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:32.863166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:32.863653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:32.864086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:32.864778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:32.865231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:32.865684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:32.992217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:33.000284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-41cdbe19-f0d3-43ef-91be-10ff38929ffb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1729 microversion: 2.1 time: 0.150632 Aug 24 05:50:33.000860 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 382/719] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:32 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:33.021416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:33.022024 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:33.028208 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:33.028687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:33.029124 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:33.029837 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:33.030287 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:33.031204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:33.106933 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-dd87108f-a5df-4b77-a3c2-25d14192c1de tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089693 Aug 24 05:50:33.107538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 338/720] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:50:33 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:34.265380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-1179024d-e612-4b20-a48e-011bb81ea799 req-8b1e3f04-b3ba-49d6-a930-aba719c7f64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d74183-be9d-44b4-8b74-95591db6be75", "tag": "7a0a208c-567e-4aee-9e6e-fb5216b6b6fe"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:34.281639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-1179024d-e612-4b20-a48e-011bb81ea799 req-8b1e3f04-b3ba-49d6-a930-aba719c7f64c service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:34.282120 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-1179024d-e612-4b20-a48e-011bb81ea799 req-8b1e3f04-b3ba-49d6-a930-aba719c7f64c service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:34.282543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-1179024d-e612-4b20-a48e-011bb81ea799 req-8b1e3f04-b3ba-49d6-a930-aba719c7f64c service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:34.293743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-1179024d-e612-4b20-a48e-011bb81ea799 req-8b1e3f04-b3ba-49d6-a930-aba719c7f64c service nova] Creating event network-changed:7a0a208c-567e-4aee-9e6e-fb5216b6b6fe for instance e9d74183-be9d-44b4-8b74-95591db6be75 on hv-cinder-85426 Aug 24 05:50:34.299338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-1179024d-e612-4b20-a48e-011bb81ea799 req-8b1e3f04-b3ba-49d6-a930-aba719c7f64c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037711 Aug 24 05:50:34.299976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 383/721] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:34.688639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:34.689151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:34.695204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:34.695682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:34.696124 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:34.696804 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:34.697250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:34.697766 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:34.725785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:50:34.810371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4a5b57d0-acd1-45ed-8830-424fcfd83092 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "DELETE /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 204 len: 0 microversion: 2.1 time: 0.125826 Aug 24 05:50:34.811551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 339/722] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:50:34 2022] DELETE /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:50:34.820216 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:34.821188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:34.828473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:34.828943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:34.829708 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:34.830500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:34.831126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:34.831547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:34.976399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:34.984315 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-366d431f-7662-47b7-8823-f5c6d0596f64 tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1514 microversion: 2.1 time: 0.168562 Aug 24 05:50:34.984880 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 384/723] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:34 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:36.006371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:36.006990 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:36.013358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:36.013875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:36.014312 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:36.015044 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:36.015557 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:36.016026 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:36.145033 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:36.152865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-662f7c85-4e8e-4e08-b2a8-0dfe9adbc2fe tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1514 microversion: 2.1 time: 0.150935 Aug 24 05:50:36.153430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 340/724] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:36 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:36.313831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-b1bffa70-9fdb-4831-a462-d747b96bda92 req-a38f061c-adfd-4ac4-bc37-01baa6c82342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d74183-be9d-44b4-8b74-95591db6be75", "tag": "7a0a208c-567e-4aee-9e6e-fb5216b6b6fe"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:36.323608 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b1bffa70-9fdb-4831-a462-d747b96bda92 req-a38f061c-adfd-4ac4-bc37-01baa6c82342 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:36.324078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b1bffa70-9fdb-4831-a462-d747b96bda92 req-a38f061c-adfd-4ac4-bc37-01baa6c82342 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:36.324500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b1bffa70-9fdb-4831-a462-d747b96bda92 req-a38f061c-adfd-4ac4-bc37-01baa6c82342 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:36.335849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-b1bffa70-9fdb-4831-a462-d747b96bda92 req-a38f061c-adfd-4ac4-bc37-01baa6c82342 service nova] Creating event network-changed:7a0a208c-567e-4aee-9e6e-fb5216b6b6fe for instance e9d74183-be9d-44b4-8b74-95591db6be75 on hv-cinder-85426 Aug 24 05:50:36.340505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-b1bffa70-9fdb-4831-a462-d747b96bda92 req-a38f061c-adfd-4ac4-bc37-01baa6c82342 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030420 Aug 24 05:50:36.341066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 385/725] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:37.175195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:37.175812 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:37.182238 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:37.182715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:37.183149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:37.183836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:37.184288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:37.184712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:37.423396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:37.431132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-56d819bf-ef42-40d6-9844-8cd692dfad1b tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1514 microversion: 2.1 time: 0.260348 Aug 24 05:50:37.431714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 341/726] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:37 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:38.356415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-55d9f47d-1b26-4061-b101-168d5abba993 req-27065606-2570-4523-8ca0-2aa3dedb5678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edba8161-3da6-49e5-a75f-00d7026681fc", "name": "network-vif-deleted", "tag": "a6cdd57d-614e-49a2-9fa9-6c80e635376f"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:38.366932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-55d9f47d-1b26-4061-b101-168d5abba993 req-27065606-2570-4523-8ca0-2aa3dedb5678 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:38.367402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-55d9f47d-1b26-4061-b101-168d5abba993 req-27065606-2570-4523-8ca0-2aa3dedb5678 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:38.367827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-55d9f47d-1b26-4061-b101-168d5abba993 req-27065606-2570-4523-8ca0-2aa3dedb5678 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:38.378850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-55d9f47d-1b26-4061-b101-168d5abba993 req-27065606-2570-4523-8ca0-2aa3dedb5678 service nova] Creating event network-vif-deleted:a6cdd57d-614e-49a2-9fa9-6c80e635376f for instance edba8161-3da6-49e5-a75f-00d7026681fc on hv-cinder-85426 Aug 24 05:50:38.383623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-55d9f47d-1b26-4061-b101-168d5abba993 req-27065606-2570-4523-8ca0-2aa3dedb5678 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031723 Aug 24 05:50:38.384251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 386/727] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:50:38.453391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:38.454058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:38.460424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:38.460887 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:38.461320 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:38.462029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:38.462488 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:38.462906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:38.481911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:38.496872 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:38.497353 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:38.497809 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:38.498254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lazy-loading 'fault' on Instance uuid edba8161-3da6-49e5-a75f-00d7026681fc {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:50:38.541248 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9cefedd37f43e6bb64a270cde9f6b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87f7a45fce204c9c9c15fae64b26b61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:38.548916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-69c82718-3379-42aa-9b81-01fba6e23b7e tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 200 len: 1309 microversion: 2.1 time: 0.100046 Aug 24 05:50:38.549481 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 342/728] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:38 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:39.570868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:39.571594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] [instance: edba8161-3da6-49e5-a75f-00d7026681fc] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:39.578465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:39.578949 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:39.579382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:39.580073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:39.580526 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:39.580948 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:39.594096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] HTTP exception thrown: Instance edba8161-3da6-49e5-a75f-00d7026681fc could not be found. Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Request method failure captured: Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc HTTP/1.1 Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbuc9Hntr-tFe5Wr0wSwI2AbhjxRmEbO2Fc-U_AF8YeGKgbtlaKtpZxbOO2J1hx8fX9XxcmdMOzycITGsVjl87MIC-4n2fEZgWTdKpy8Pxce-haDq_9ymrYKT7gUHvquAACXqpRUsd0y5DJqhhJgr2pAQjba39HqgPS1P3Zd5_MU-dw Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 87f7a45fce204c9c9c15fae64b26b61e Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesSnapshotTestJSON-601238525 Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:50:39.595721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/87f7a45fce204c9c9c15fae64b26b61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesSnapshotTestJSON-601238525 Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 87f7a45fce204c9c9c15fae64b26b61e Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-601238525 Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesSnapshotTestJSON-601238525-project Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 8e9cefedd37f43e6bb64a270cde9f6b6 Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesSnapshotTestJSON-601238525-project Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance edba8161-3da6-49e5-a75f-00d7026681fc could not be found. Aug 24 05:50:39.597353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': 'edba8161-3da6-49e5-a75f-00d7026681fc'} Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edba8161-3da6-49e5-a75f-00d7026681fc could not be found. Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:50:39.598289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edba8161-3da6-49e5-a75f-00d7026681fc could not be found. Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edba8161-3da6-49e5-a75f-00d7026681fc could not be found. Aug 24 05:50:39.599755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:50:39.601153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] Returning 404 to user: Instance edba8161-3da6-49e5-a75f-00d7026681fc could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:50:39.601153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c0c429c4-81d3-4b2f-a3b2-0ff1cd4d881a tempest-VolumesSnapshotTestJSON-601238525 tempest-VolumesSnapshotTestJSON-601238525-project] 10.222.0.73 "GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc" status: 404 len: 111 microversion: 2.1 time: 0.030373 Aug 24 05:50:39.601153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 387/729] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:39 2022] GET /compute/v2.1/servers/edba8161-3da6-49e5-a75f-00d7026681fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:50:48.677300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:50:48.679704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:48.682294 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:48.682946 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=4 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:50:48.689497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:48.690002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:48.690439 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:48.691133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:48.691589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:48.692015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:48.764861 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c83f3a2e-e4b0-41ad-b96b-4cb8e5bd4ea4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/action" status: 202 len: 0 microversion: 2.1 time: 0.091214 Aug 24 05:50:48.765517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 343/730] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:50:48 2022] POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:50:48.773635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:48.774339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:48.782372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:48.782841 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:48.783385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:48.784345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:48.784941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:48.785476 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:48.932639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:48.941192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ae584fb2-9beb-454a-9e51-865c00379691 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1749 microversion: 2.1 time: 0.171410 Aug 24 05:50:48.941804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 388/731] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:48 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:49.962747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:49.963452 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:49.969657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:49.970136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:49.970574 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:49.971297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:49.971755 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:49.972179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:50.159988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:50.168117 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b25e3a3c-86bf-40fb-bb03-c094cbd51639 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1749 microversion: 2.1 time: 0.210169 Aug 24 05:50:50.168678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 344/732] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:49 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1749 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:51.190121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:51.190736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:51.197128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:51.197643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:51.198082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:51.198771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:51.199223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:51.199648 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:51.396309 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:51.404369 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-da0a98ae-a4d0-4b6a-bc67-58a475246253 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.218849 Aug 24 05:50:51.404927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 389/733] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:51 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:52.426870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:52.427485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:52.433884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:52.434370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:52.434805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:52.435494 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:52.435944 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:52.436364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:52.584088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:52.595629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e28a0047-0343-4ae7-be75-6d79da241d9e tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.173161 Aug 24 05:50:52.596222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 345/734] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:52 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:53.619562 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:53.620385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:53.627392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.628333 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.629319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.630169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:53.631253 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:53.632057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:53.784557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:53.792787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5b532817-4704-4057-bd3a-e65d7976b2ad tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.178874 Aug 24 05:50:53.793354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 390/735] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:53 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:54.814978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:54.816127 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:54.822849 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.823397 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.823853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:54.824555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:54.825009 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:54.825430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:54.966589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:54.975063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8ba47b58-f086-414e-b711-dedc92575ab0 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.164530 Aug 24 05:50:54.975626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 346/736] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:54 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:55.996748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:55.997352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:56.004195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:56.004671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:56.005100 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:56.005814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:56.006262 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:56.006683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:56.146178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:56.154601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6bc6bf14-e94b-49d9-a8ef-35bd17c24eb3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.161549 Aug 24 05:50:56.155189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 391/737] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:55 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:50:57.177285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:57.177928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:57.184452 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:57.184940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:57.185376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:57.186100 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:57.186572 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:57.186999 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:57.329770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:57.338167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-448ecd86-a9f7-4def-a0b8-fc16c227ac23 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.165409 Aug 24 05:50:57.338743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 347/738] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:57 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:58.360838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:58.361439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:58.367815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:58.368290 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:58.368775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:58.369454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:58.369936 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:58.370417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:58.519416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:58.527540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f14cf4ce-e12c-433a-80bd-40eafaa8edf4 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.171063 Aug 24 05:50:58.528100 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 392/739] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:58 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:50:59.550383 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:50:59.550926 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:50:59.557405 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.557919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.558357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.559055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:50:59.559506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:50:59.559929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:50:59.703639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:50:59.712303 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-22391324-be27-4e01-a4e5-e556ba48be05 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.166582 Aug 24 05:50:59.712872 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 348/740] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:50:59 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:00.734049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:00.734662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:00.737156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=26 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:00.742479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:00.742958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:00.743385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:00.744072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:00.744521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:00.744938 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:00.887738 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:00.896034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d7861fd4-efc4-489d-81c9-3d64d7fc45dc tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.166146 Aug 24 05:51:00.896607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 393/741] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:00 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:01.193602 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:01.194097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:01.199987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.200464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.200897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.201598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.202053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.202474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.230955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9d472b47-63e2-497d-a413-a68407d58c9f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments/146be8de-5993-49bd-9742-f6842b37386f" status: 200 len: 194 microversion: 2.20 time: 0.141502 Aug 24 05:51:01.231515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 349/742] 10.222.0.73 () {60 vars in 1454 bytes} [Wed Aug 24 05:51:01 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments/146be8de-5993-49bd-9742-f6842b37386f => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:51:01.298527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:01.299018 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:01.304762 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.305231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.305711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.306393 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.306835 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.307248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.430257 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lazy-loading 'services' on Instance uuid 48d5dce2-87d9-41e2-87bd-e25ffdab7014 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:01.541840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dbca33b1-2337-4b02-a82c-dad39a079701 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments/146be8de-5993-49bd-9742-f6842b37386f" status: 202 len: 0 microversion: 2.20 time: 0.247765 Aug 24 05:51:01.542424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 394/743] 10.222.0.73 () {60 vars in 1457 bytes} [Wed Aug 24 05:51:01 2022] DELETE /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments/146be8de-5993-49bd-9742-f6842b37386f => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:51:01.551163 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:01.553440 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:01.559757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.560285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.560725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.561461 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.561953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.562378 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.593143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d097c572-4fb5-4fe7-849c-ad6e0ad275b1 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046066 Aug 24 05:51:01.593743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 350/744] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 05:51:01 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:51:01.918816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:01.919500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:01.925863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.926361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.926793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:01.927477 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:01.927925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:01.928373 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.075955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:02.084562 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-891ba8fc-07eb-47b0-812d-c3b1e0b55f39 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.170431 Aug 24 05:51:02.085214 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 395/745] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:01 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:02.606170 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:02.608578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:02.615689 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.616175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.616610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.617316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:02.617797 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:02.618224 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:02.649483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-44497584-aab9-48be-ade2-dc6fc7aae6fe tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047382 Aug 24 05:51:02.650131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 351/746] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 05:51:02 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:51:03.106031 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:03.106919 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:03.113432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.113966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.114375 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.115064 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.115516 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.115936 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.118633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:03.384612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:03.394314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-302c2066-8a1b-4f76-b0ba-2577338a72d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.292073 Aug 24 05:51:03.395099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 396/747] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:03 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:03.662293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:03.664544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:03.671046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.672739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.673870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.675475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.675475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.675692 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.705117 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6d40f8b5-df52-4d04-be46-c1fb0f6e69c2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046727 Aug 24 05:51:03.705714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 352/748] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 05:51:03 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:03.779024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:03.779522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:03.786216 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.786630 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.787060 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.787747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.788194 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.788642 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.813864 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:03.895479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-812c4690-bc58-4737-942f-125090d5151a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 204 len: 0 microversion: 2.20 time: 0.119804 Aug 24 05:51:03.895894 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 397/749] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 05:51:03 2022] DELETE /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 05:51:03.908203 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:03.908821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:03.914811 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.915305 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.915744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:03.916581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:03.916924 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:03.917346 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.071893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.080758 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.082340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.083551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-cde3257d-8278-43bb-b60f-d3126b92242d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.182672 Aug 24 05:51:04.084131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 353/750] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:03 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:04.417259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:04.417911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:04.424965 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.425442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.425919 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.426608 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:04.427059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:04.427483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:04.566426 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:04.574527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-57c76905-a86d-48b7-872a-50ea5bc528d3 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.161684 Aug 24 05:51:04.575093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 398/751] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:04 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:05.107411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:05.108059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:05.115379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.115861 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.116300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.116992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.117447 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.117899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.245403 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:05.253457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:05.254999 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:05.256152 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8dcf4020-4e59-4856-a108-88412055683e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.152676 Aug 24 05:51:05.256712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 354/752] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:05 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:05.595570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:05.596181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:05.604026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.604728 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.605411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.606257 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:05.606714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:05.607139 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:05.758940 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:05.767572 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-768ecd54-6954-459c-926b-4b8d5b5f4850 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.176000 Aug 24 05:51:05.768145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 399/753] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:05 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:06.279856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:06.280475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:06.287427 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:06.287908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:06.288342 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:06.289038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:06.289523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:06.289973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:06.775000 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.783742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.785296 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.786462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2d51c162-7a24-4d88-babf-b6fa5519ecf0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1723 microversion: 2.20 time: 0.510546 Aug 24 05:51:06.787012 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 355/754] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:06 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1723 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:06.788845 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:06.789458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:06.796072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:06.796795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:06.797402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:06.798330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:06.799081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:06.799999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:06.944199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:06.952496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b4977b56-b83f-4645-9a01-e6e8124d5c7c tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.167419 Aug 24 05:51:06.953066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 400/755] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:06 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:07.286279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-072eefc1-105f-4197-9871-c60dfee11e80 req-c91cad39-8b8c-4082-b81d-002c463300fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d5dce2-87d9-41e2-87bd-e25ffdab7014", "name": "network-vif-deleted", "tag": "837c49ba-3839-4640-af5d-797916aa3934"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:07.297002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-072eefc1-105f-4197-9871-c60dfee11e80 req-c91cad39-8b8c-4082-b81d-002c463300fc service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.298289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-072eefc1-105f-4197-9871-c60dfee11e80 req-c91cad39-8b8c-4082-b81d-002c463300fc service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.298842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-072eefc1-105f-4197-9871-c60dfee11e80 req-c91cad39-8b8c-4082-b81d-002c463300fc service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.319489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-072eefc1-105f-4197-9871-c60dfee11e80 req-c91cad39-8b8c-4082-b81d-002c463300fc service nova] Creating event network-vif-deleted:837c49ba-3839-4640-af5d-797916aa3934 for instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 on hv-cinder-85426 Aug 24 05:51:07.324815 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-072eefc1-105f-4197-9871-c60dfee11e80 req-c91cad39-8b8c-4082-b81d-002c463300fc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042954 Aug 24 05:51:07.325418 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 356/756] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:07.809862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:07.811075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:07.817957 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.818442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.818876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.819571 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.820024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.820447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.852145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.852633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.853071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.853508 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lazy-loading 'fault' on Instance uuid 48d5dce2-87d9-41e2-87bd-e25ffdab7014 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:07.895730 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.905281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.906881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:07.908057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-edbdb762-ff5b-44b3-a978-f6fb5bed2046 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 200 len: 1372 microversion: 2.20 time: 0.102150 Aug 24 05:51:07.908630 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 401/757] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:07 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:07.974490 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:07.975222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:07.981398 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.981908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.982341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:07.983030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:07.983735 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:07.984146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.151625 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:08.160439 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d9d5c112-3d97-42cc-a817-b4e23ce59682 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1754 microversion: 2.1 time: 0.190194 Aug 24 05:51:08.161207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 357/758] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:07 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:08.930537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:08.931234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:08.938482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.939137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.939624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.940336 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:08.940824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:08.941437 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:08.955706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] HTTP exception thrown: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Request method failure captured: Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 HTTP/1.1 Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsXOfKWEejOFx7fL815iUihSZUeqT0FnFfYIOoUjATZIa30KOvQxKFcvEo28Mwdhx-ci4ef-6-dxE45u6IC0B-rSrWZtq0ytnlcF8NGM09s1nSL-T3stdbzMdhpU-ftFIoWhGbAg42DJdHiNjlsh1RR0fS_RKqfRXGyfpq0oz9t2ZI Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:51:08.957555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_47156a6d045b4147a837fbf132421a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/47156a6d045b4147a837fbf132421a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 0b18352a23444324b27d17d2cee636fc Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:51:08.959582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '48d5dce2-87d9-41e2-87bd-e25ffdab7014'} Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:08.961134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:51:08.963046 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:08.964581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Returning 404 to user: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:08.964581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a573fb31-49cf-4cd6-b329-f47f2fc39831 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 404 len: 111 microversion: 2.20 time: 0.032345 Aug 24 05:51:08.964581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 402/759] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:08 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:51:08.968448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c750c641-4cc7-469b-bd5e-b423d0c173ec tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '.version_select at 0x7fa920bcb040>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:08.991011 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c750c641-4cc7-469b-bd5e-b423d0c173ec tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363600537" status: 204 len: 0 microversion: 2.20 time: 0.026615 Aug 24 05:51:08.991583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 358/760] 10.222.0.73 () {60 vars in 1262 bytes} [Wed Aug 24 05:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363600537 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:51:09.182091 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:09.182700 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:09.188838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:09.189314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:09.189766 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:09.190458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:09.190899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:09.191328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:09.343583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:09.352099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-56cc292a-2419-4818-815c-11c54685b9c8 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1757 microversion: 2.1 time: 0.173889 Aug 24 05:51:09.352815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 403/761] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:09 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:09.699544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-63871b6d-3827-4e4c-97d0-c1614097e695 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'create', calling method: .version_select at 0x7fa920b8e670>, body: {"keypair": {"name": "tempest-keypair-1671722112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOk6ckApcgoZvH3DxlMk4aICzuoL4AEKiViVUGZET+7FyAOZqu8J3WejHO0C8f0/xEHwjudliQfYlhErP1p5Ek3WoZ4HOXUB6yvN5YWpQsYDayTv0uqz6/6V0ZSu9USMA=="}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:09.715064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-63871b6d-3827-4e4c-97d0-c1614097e695 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for project 47156a6d045b4147a837fbf132421a53. Resources: {'key_pairs'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:51:09.719106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-63871b6d-3827-4e4c-97d0-c1614097e695 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for user 0b18352a23444324b27d17d2cee636fc and project 47156a6d045b4147a837fbf132421a53. Resources: {'key_pairs'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:51:09.740312 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-63871b6d-3827-4e4c-97d0-c1614097e695 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044861 Aug 24 05:51:09.740897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 359/762] 10.222.0.73 () {62 vars in 1200 bytes} [Wed Aug 24 05:51:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 05:51:11.014475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-615904058", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5cb66fbe-84cf-4e7a-9635-478f9b0fa356"}], "security_groups": [{"name": "tempest-securitygroup--771881460"}], "key_name": "tempest-keypair-1671722112", "user_data": "}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:11.117844 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] validate_networks() for [('5cb66fbe-84cf-4e7a-9635-478f9b0fa356', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:51:11.773525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:51:11.773988 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:51:11.774449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:51:11.774847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:51:11.775249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:51:11.783750 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:11.784216 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:11.784640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:11.785347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:11.785818 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:11.786235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:11.802673 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for project 47156a6d045b4147a837fbf132421a53. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:51:11.806594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Getting quotas for user 0b18352a23444324b27d17d2cee636fc and project 47156a6d045b4147a837fbf132421a53. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:51:11.818022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:51:11.820254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:51:11.865195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-54796267-b91c-4b7e-ac54-021891f98149 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.854951 Aug 24 05:51:11.865867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 404/763] 10.222.0.73 () {62 vars in 1188 bytes} [Wed Aug 24 05:51:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 05:51:11.877517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2e4e7a20-7a82-4e5b-aac0-5bb2efc4fe25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:11.878141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2e4e7a20-7a82-4e5b-aac0-5bb2efc4fe25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:11.931680 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2e4e7a20-7a82-4e5b-aac0-5bb2efc4fe25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.939793 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2e4e7a20-7a82-4e5b-aac0-5bb2efc4fe25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.942516 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2e4e7a20-7a82-4e5b-aac0-5bb2efc4fe25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:11.943638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2e4e7a20-7a82-4e5b-aac0-5bb2efc4fe25 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1281 microversion: 2.20 time: 0.070979 Aug 24 05:51:11.944210 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 360/764] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:11 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:12.966326 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:12.966956 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:12.974282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.974746 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.975170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:12.975857 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:12.976297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:12.976711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:13.039209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.047547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.049003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:13.050131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2bbcb4e4-a307-4098-b41c-979a57259e7b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1333 microversion: 2.20 time: 0.088287 Aug 24 05:51:13.050691 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 405/765] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:12 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:14.072527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:14.073144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:14.079853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.080271 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.080707 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.081407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.081891 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.082317 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.291807 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.300318 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.301854 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:14.302952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fde552c5-81a6-42cb-aa68-b7188328a38c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1406 microversion: 2.20 time: 0.234369 Aug 24 05:51:14.303513 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 361/766] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:14 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:14.560058 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-29f4bb90-ce7f-453e-825d-6e10281ad0af req-ac327eba-e174-4871-90a8-ba6d292b773b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a6fa69-6942-458d-b3a8-7eb647fa331f", "tag": "3088fe36-419f-41a4-bcd1-c2ce02a2cd29"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:14.572461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-29f4bb90-ce7f-453e-825d-6e10281ad0af req-ac327eba-e174-4871-90a8-ba6d292b773b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:14.572927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-29f4bb90-ce7f-453e-825d-6e10281ad0af req-ac327eba-e174-4871-90a8-ba6d292b773b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:14.573386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-29f4bb90-ce7f-453e-825d-6e10281ad0af req-ac327eba-e174-4871-90a8-ba6d292b773b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:14.586365 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-29f4bb90-ce7f-453e-825d-6e10281ad0af req-ac327eba-e174-4871-90a8-ba6d292b773b service nova] Creating event network-changed:3088fe36-419f-41a4-bcd1-c2ce02a2cd29 for instance 31a6fa69-6942-458d-b3a8-7eb647fa331f on hv-cinder-85426 Aug 24 05:51:14.591423 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-29f4bb90-ce7f-453e-825d-6e10281ad0af req-ac327eba-e174-4871-90a8-ba6d292b773b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035055 Aug 24 05:51:14.592015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 406/767] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:15.326776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:15.327385 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:15.333825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:15.334301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:15.334731 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:15.335422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:15.335877 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:15.336300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:15.340341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:15.465838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:15.474545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:15.476121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:15.477220 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9a8ac036-7f90-422b-a656-aaaddb481349 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1406 microversion: 2.20 time: 0.154364 Aug 24 05:51:15.477878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 362/768] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:15 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:16.501745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:16.502570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:16.509024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:16.509492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:16.509954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:16.510637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:16.511079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:16.511493 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:16.666488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.678586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.680114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:16.681251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-315a513a-e148-458a-9fb2-899fc6b4e83a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1406 microversion: 2.20 time: 0.184680 Aug 24 05:51:16.682148 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 407/769] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:16 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:16.753754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:16.754286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:16.760395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:16.760897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:16.761327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:16.762057 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:16.762513 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:16.762938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:16.788225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7ad18cc7-a261-416c-ba98-5adf5fb6aacd tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/ips" status: 200 len: 148 microversion: 2.1 time: 0.231272 Aug 24 05:51:16.788805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 363/770] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:51:16 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/ips => generated 148 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:17.705098 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:17.705730 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:17.712146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.712733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.713099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.713926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:17.714374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:17.714788 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:17.844508 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.852547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.854076 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:17.855211 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1bf61cb0-cf9d-4b83-84cb-45d2fc524845 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1406 microversion: 2.20 time: 0.154721 Aug 24 05:51:17.855781 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 408/771] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:17 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:18.118058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef4a49f4-d155-4ce3-b285-dd66cd443137"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:18.120603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:18.127733 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.128218 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.128661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.129394 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.129878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.130305 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.390503 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ec661c10-6163-48bc-a0fa-b0153d282d52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276205 Aug 24 05:51:18.391343 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 364/772] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:51:18 2022] POST /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:18.877596 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:18.878137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:18.884430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.884902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.885330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:18.886045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:18.886495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:18.886911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:19.018624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:19.026627 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:19.028211 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:19.029297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8fd35b96-868b-46bb-842c-0c9db5f4b7ba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1406 microversion: 2.20 time: 0.155740 Aug 24 05:51:19.029887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 409/773] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:18 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:19.597869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-a2be8603-7079-4b57-8183-2a3f922d49f8 req-2a26f4df-95dc-4085-baee-72ff63c7864b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6fa69-6942-458d-b3a8-7eb647fa331f", "name": "network-vif-plugged", "status": "completed", "tag": "3088fe36-419f-41a4-bcd1-c2ce02a2cd29"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:19.603716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:19.612286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a2be8603-7079-4b57-8183-2a3f922d49f8 req-2a26f4df-95dc-4085-baee-72ff63c7864b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:19.612775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a2be8603-7079-4b57-8183-2a3f922d49f8 req-2a26f4df-95dc-4085-baee-72ff63c7864b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:19.613235 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a2be8603-7079-4b57-8183-2a3f922d49f8 req-2a26f4df-95dc-4085-baee-72ff63c7864b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:19.628392 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-a2be8603-7079-4b57-8183-2a3f922d49f8 req-2a26f4df-95dc-4085-baee-72ff63c7864b service nova] Creating event network-vif-plugged:3088fe36-419f-41a4-bcd1-c2ce02a2cd29 for instance 31a6fa69-6942-458d-b3a8-7eb647fa331f on hv-cinder-85426 Aug 24 05:51:19.633543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-a2be8603-7079-4b57-8183-2a3f922d49f8 req-2a26f4df-95dc-4085-baee-72ff63c7864b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040162 Aug 24 05:51:19.634179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 365/774] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:20.052973 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:20.053491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:20.059881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:20.060352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:20.060776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:20.061453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:20.061927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:20.062345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:20.191061 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.199037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.200519 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:20.201623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fc2856bf-19cf-46fc-af89-aa6f8f485c27 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1406 microversion: 2.20 time: 0.152579 Aug 24 05:51:20.202501 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 410/775] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:20 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:51:21.225233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:21.225962 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:21.232682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.233223 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.233876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.235044 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:21.235497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:21.235916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:21.368664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.376697 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.378618 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:21.379725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-806e645b-9f2b-4753-9b8b-c2bfd622400c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1406 microversion: 2.20 time: 0.159175 Aug 24 05:51:21.380291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 366/776] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:21 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:22.401824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:22.402424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:22.404521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:22.405445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=6 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:22.411264 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.411732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.412156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.412829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.413270 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.413710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.540251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.549077 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.550631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:22.551785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7e97812a-3630-48d8-a60e-16dff35abc6c tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1598 microversion: 2.20 time: 0.153883 Aug 24 05:51:22.552353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 411/777] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:51:22 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:51:22.574581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:22.575070 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:22.577407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=6 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:22.583345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.583828 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.584262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.584952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.585402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.585854 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.663445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e41c4408-1c6a-4dab-81a1-157b0fc74649 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092674 Aug 24 05:51:22.664042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 367/778] 10.222.0.73 () {60 vars in 1316 bytes} [Wed Aug 24 05:51:22 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:51:22.898305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:22.898800 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:22.904593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.905073 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.905500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.906206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:22.907418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:22.907855 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:22.985351 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:22.991987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lazy-loading 'services' on Instance uuid e9d74183-be9d-44b4-8b74-95591db6be75 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:23.065354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-395e8060-2e87-4d93-9a0c-4ea67c495262 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments/c2ae9736-2a15-4840-95b3-09d61b94207d" status: 202 len: 0 microversion: 2.1 time: 0.170799 Aug 24 05:51:23.065993 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 412/779] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:51:22 2022] DELETE /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments/c2ae9736-2a15-4840-95b3-09d61b94207d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:23.074622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:23.077967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:23.085470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.086622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.087301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.088264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.088821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.089554 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.127750 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-97f1c61b-62c3-4a41-ae37-f5cf4393a288 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057190 Aug 24 05:51:23.128443 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 368/780] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:23 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:23.581479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-a6ec54c6-3039-4100-a1ee-4b22d76d0626 req-6afc1a23-3c6f-4f43-8236-8ce8c63f1fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31a6fa69-6942-458d-b3a8-7eb647fa331f", "tag": "3088fe36-419f-41a4-bcd1-c2ce02a2cd29"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:23.591111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-a6ec54c6-3039-4100-a1ee-4b22d76d0626 req-6afc1a23-3c6f-4f43-8236-8ce8c63f1fad service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:23.591662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-a6ec54c6-3039-4100-a1ee-4b22d76d0626 req-6afc1a23-3c6f-4f43-8236-8ce8c63f1fad service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:23.592162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-a6ec54c6-3039-4100-a1ee-4b22d76d0626 req-6afc1a23-3c6f-4f43-8236-8ce8c63f1fad service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:23.602951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-a6ec54c6-3039-4100-a1ee-4b22d76d0626 req-6afc1a23-3c6f-4f43-8236-8ce8c63f1fad service nova] Creating event network-changed:3088fe36-419f-41a4-bcd1-c2ce02a2cd29 for instance 31a6fa69-6942-458d-b3a8-7eb647fa331f on hv-cinder-85426 Aug 24 05:51:23.607757 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-a6ec54c6-3039-4100-a1ee-4b22d76d0626 req-6afc1a23-3c6f-4f43-8236-8ce8c63f1fad service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031248 Aug 24 05:51:23.608812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 413/781] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:24.140639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:24.143413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:24.149990 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:24.150473 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:24.151458 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:24.152170 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:24.152629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:24.153053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:24.190254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-202891f4-ba59-4724-ba25-6704c9c2c36d tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053594 Aug 24 05:51:24.191208 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 369/782] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:24 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:25.204601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:25.206931 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:25.213167 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.213653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.214080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.214771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.215212 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.215639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.244719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f11922b8-c07b-4ab7-9fd1-4c3216ab3cf4 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Aug 24 05:51:25.245284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 414/783] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:25 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:25.914508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef4a49f4-d155-4ce3-b285-dd66cd443137"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:25.917140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:25.924426 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.924911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.925351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:25.926088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:25.926543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:25.926967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.004571 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Invalid volume: volume ef4a49f4-d155-4ce3-b285-dd66cd443137 is already attached to instances: 3a2e0976-7c32-4f6c-a456-66c19a291d92 Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: POST /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments HTTP/1.1 Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 74 Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:51:26.006624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {"volumeAttachment": {"volumeId": "ef4a49f4-d155-4ce3-b285-dd66cd443137"}} Aug 24 05:51:26.008183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Invalid volume: volume ef4a49f4-d155-4ce3-b285-dd66cd443137 is already attached to instances: 3a2e0976-7c32-4f6c-a456-66c19a291d92 Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'server_id': '3a2e0976-7c32-4f6c-a456-66c19a291d92', 'body': {'volumeAttachment': {'volumeId': 'ef4a49f4-d155-4ce3-b285-dd66cd443137'}}} Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ef4a49f4-d155-4ce3-b285-dd66cd443137 is already attached to instances: 3a2e0976-7c32-4f6c-a456-66c19a291d92 Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:26.012361 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ef4a49f4-d155-4ce3-b285-dd66cd443137 is already attached to instances: 3a2e0976-7c32-4f6c-a456-66c19a291d92 Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:26.013852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ef4a49f4-d155-4ce3-b285-dd66cd443137 is already attached to instances: 3a2e0976-7c32-4f6c-a456-66c19a291d92 Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 400 to user: Invalid volume: volume ef4a49f4-d155-4ce3-b285-dd66cd443137 is already attached to instances: 3a2e0976-7c32-4f6c-a456-66c19a291d92 {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c8bd2f7a-c0f2-4cae-a28d-bb7e3ed62515 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097696 Aug 24 05:51:26.015354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 370/784] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:51:25 2022] POST /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:51:26.071972 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.072407 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.078311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.078798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.079234 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.079960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.080578 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.081107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.167498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lazy-loading 'services' on Instance uuid 3a2e0976-7c32-4f6c-a456-66c19a291d92 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:26.240079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-851e02d0-b187-41f6-9d9b-f1dd9df753f3 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments/ef4a49f4-d155-4ce3-b285-dd66cd443137" status: 202 len: 0 microversion: 2.1 time: 0.171909 Aug 24 05:51:26.241049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 415/785] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:51:26 2022] DELETE /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments/ef4a49f4-d155-4ce3-b285-dd66cd443137 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:26.249154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.251571 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.258845 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.259417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.260053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.260821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.261166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.261417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.261944 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.263439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.277540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.278034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.278459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.279154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.279594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.280217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.295358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b9657131-6b4d-47c9-8131-126043499a17 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050188 Aug 24 05:51:26.296288 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 371/786] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:26 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:26.309471 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6c910ec7-dfb1-4694-bae6-511863c7dbc3 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054998 Aug 24 05:51:26.310052 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 416/787] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:26 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:51:26.387062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.387587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.394254 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.394762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.395199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.395899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.396351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.396776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.421807 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:26.494425 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-642527d6-8ef4-4242-beda-f5bc6a980b4e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 204 len: 0 microversion: 2.1 time: 0.110994 Aug 24 05:51:26.494997 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 372/788] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:51:26 2022] DELETE /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:51:26.502800 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:26.503407 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:26.509166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.509660 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.510089 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.510771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:26.511221 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:26.511639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:26.642982 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:26.651495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e6af9947-ea91-4f10-932b-0fb25d37a7b0 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1689 microversion: 2.1 time: 0.152398 Aug 24 05:51:26.652064 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 417/789] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:26 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:27.308779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:27.311056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:27.317422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.317935 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.318378 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.319068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.319519 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.319945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.351058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-014023d1-837f-4f51-8a0c-dcb8d91973d8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046697 Aug 24 05:51:27.351610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 373/790] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:27 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:27.671803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:27.672979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:27.679388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.679865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.680296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.680981 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:27.681427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:27.681878 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:27.809766 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:27.817427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a1649564-4fab-4429-b558-6a6acf18434a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1689 microversion: 2.1 time: 0.149467 Aug 24 05:51:27.818023 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 418/791] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:27 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:28.363962 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:28.366164 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:28.372487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.372962 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.373388 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.374105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.374550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.374966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.403991 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-27ba5034-6fa0-4af8-8c59-64ad4115a30f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Aug 24 05:51:28.404539 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 374/792] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:28 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:28.838928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:28.839542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:28.846107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.846584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.847015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.847698 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:28.848149 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:28.848570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:28.978602 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:28.987199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-571dbf53-2423-4dfa-bb95-912cac0a7acb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1689 microversion: 2.1 time: 0.152172 Aug 24 05:51:28.987767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 419/793] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:28 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:29.415521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:29.417718 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:29.424144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.424629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.425067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.425793 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:29.426249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:29.426673 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:29.455413 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8d28b2ac-df5c-46c3-b2d5-20c68b08654e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Aug 24 05:51:29.455968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 375/794] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:29 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:30.008132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:30.008712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:30.015010 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:30.015493 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:30.015932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:30.016622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:30.017078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:30.017503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:30.144899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:30.152594 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7b5c0420-6f18-4e09-a4c0-1dfc9571c765 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1689 microversion: 2.1 time: 0.148407 Aug 24 05:51:30.153193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 420/795] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:30 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:30.466889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:30.470058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:30.476502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:30.476983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:30.477441 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:30.478157 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:30.478609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:30.479030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:30.508865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bb32b5c8-a44e-4de5-9958-102c1de03185 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Aug 24 05:51:30.509428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 376/796] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:30 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:31.172656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.173366 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.175741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:31.180907 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.181382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.181836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.182531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.183110 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.183527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.256710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:31.265464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0bc04e60-0f31-4058-a244-472d416607fb tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1621 microversion: 2.1 time: 0.096563 Aug 24 05:51:31.278092 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 421/797] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:31 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1621 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:31.512450 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-f8229648-4be2-4749-864c-257f979afeaa req-8b9f60fa-0a47-4799-9560-19d01b86b91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d74183-be9d-44b4-8b74-95591db6be75", "name": "network-vif-deleted", "tag": "7a0a208c-567e-4aee-9e6e-fb5216b6b6fe"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:31.520282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.526392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.537360 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-f8229648-4be2-4749-864c-257f979afeaa req-8b9f60fa-0a47-4799-9560-19d01b86b91b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.541083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.542025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-f8229648-4be2-4749-864c-257f979afeaa req-8b9f60fa-0a47-4799-9560-19d01b86b91b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.542867 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-f8229648-4be2-4749-864c-257f979afeaa req-8b9f60fa-0a47-4799-9560-19d01b86b91b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.544033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.544532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.545450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.546121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.546749 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.549722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:31.563426 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-f8229648-4be2-4749-864c-257f979afeaa req-8b9f60fa-0a47-4799-9560-19d01b86b91b service nova] Creating event network-vif-deleted:7a0a208c-567e-4aee-9e6e-fb5216b6b6fe for instance e9d74183-be9d-44b4-8b74-95591db6be75 on hv-cinder-85426 Aug 24 05:51:31.574725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-f8229648-4be2-4749-864c-257f979afeaa req-8b9f60fa-0a47-4799-9560-19d01b86b91b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120328 Aug 24 05:51:31.580188 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 377/798] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:31.589074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cb1397cf-70be-4934-8d35-5f65de15c586 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072607 Aug 24 05:51:31.590026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 422/799] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:31 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:51:31.678074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.678648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.690776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.691268 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.691700 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.692406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.692856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.693267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.719943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:31.799098 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7f8e7cf0-d85e-4478-99a3-d104be72d2c8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 204 len: 0 microversion: 2.1 time: 0.125810 Aug 24 05:51:31.799567 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 378/800] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:51:31 2022] DELETE /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:51:31.808069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:31.808905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:31.814753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.815302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.815722 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.816417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:31.816876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:31.817298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:31.951890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:31.959539 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-82fa9adf-1d4d-4435-967d-a28bfd31b55e tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1680 microversion: 2.1 time: 0.155581 Aug 24 05:51:31.960114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 423/801] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:31 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:32.288446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:32.289148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:32.295391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.295882 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.296324 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.297059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.297517 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.297984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.329249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.329770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.330209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.330653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lazy-loading 'fault' on Instance uuid e9d74183-be9d-44b4-8b74-95591db6be75 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:32.372133 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:32.380135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-421315d8-9650-4142-b69b-05749b5427d6 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1335 microversion: 2.1 time: 0.096041 Aug 24 05:51:32.380710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 379/802] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:32 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:32.981360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:32.982015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:32.989330 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.989845 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.990284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:32.990976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:32.991427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:32.991851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.121580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:33.129849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-07bcb79d-afc9-4082-b409-0887cdca38f7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1680 microversion: 2.1 time: 0.152285 Aug 24 05:51:33.130413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 424/803] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:32 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:33.400311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:33.400857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:33.407840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.408321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.408756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.409449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.409928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.410354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.440821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:33.441299 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:33.441769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:33.442215 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lazy-loading 'fault' on Instance uuid e9d74183-be9d-44b4-8b74-95591db6be75 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:33.481686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:33.490247 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9934dade-8bc4-435c-ab08-267f037ab479 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 200 len: 1335 microversion: 2.1 time: 0.093862 Aug 24 05:51:33.490811 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 380/804] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:33 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 1335 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:34.150760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:34.151366 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:34.157914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:34.158389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:34.158818 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:34.159510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:34.159960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:34.160473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:34.302929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:34.311411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f5fc34bf-8844-4767-9e29-93bd269c0174 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1680 microversion: 2.1 time: 0.164450 Aug 24 05:51:34.312072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 425/805] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:34 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:34.509778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:34.510393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e9d74183-be9d-44b4-8b74-95591db6be75] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:34.516886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:34.517364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:34.517900 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:34.518594 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:34.519047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:34.519467 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:34.534692 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] HTTP exception thrown: Instance e9d74183-be9d-44b4-8b74-95591db6be75 could not be found. Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Request method failure captured: Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 HTTP/1.1 Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsdP7Q-t8JRnuv4BFU0EFKbt_HtrMXv561NX0UrC6t-iBOAcNLf5m4dhrd4VtGj3WNb3JuuyIrLxJC09Afr6RfY3LKXcmcuolAwf26AfOMVx8jQxsuDTZYMf7rtd4_ZRgZ8V6YAidgJ7qvXt3Re-KaPSji-ET6Pzsg3lCvUveQavBk Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:51:34.536337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3726a58288d9455b97e041a2e92f8850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 3d8467cc62d948038690af1fdf5bb96a Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance e9d74183-be9d-44b4-8b74-95591db6be75 could not be found. Aug 24 05:51:34.537945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': 'e9d74183-be9d-44b4-8b74-95591db6be75'} Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d74183-be9d-44b4-8b74-95591db6be75 could not be found. Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:34.538719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d74183-be9d-44b4-8b74-95591db6be75 could not be found. Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d74183-be9d-44b4-8b74-95591db6be75 could not be found. Aug 24 05:51:34.540039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:34.543825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Returning 404 to user: Instance e9d74183-be9d-44b4-8b74-95591db6be75 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:34.543825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e3891c5e-f9ab-4815-94cb-488a2ececf69 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75" status: 404 len: 111 microversion: 2.1 time: 0.031840 Aug 24 05:51:34.543825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 381/806] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:34 2022] GET /compute/v2.1/servers/e9d74183-be9d-44b4-8b74-95591db6be75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:51:34.548241 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7089f50c-f856-4039-9921-0e702ccc1958 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '.version_select at 0x7fa91c339430>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:34.568225 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7089f50c-f856-4039-9921-0e702ccc1958 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324129782" status: 202 len: 0 microversion: 2.1 time: 0.025386 Aug 24 05:51:34.568812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 426/807] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 05:51:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324129782 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:35.133002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-25970849-0ed2-49e5-85b3-f9a388ecf8b7 req-a5dd25bf-ae6d-42e2-87b0-45b7f6eaca8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a2e0976-7c32-4f6c-a456-66c19a291d92", "name": "network-vif-deleted", "tag": "d1ec8ac2-e17b-4798-b8fc-fe46228d109e"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:35.146132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-25970849-0ed2-49e5-85b3-f9a388ecf8b7 req-a5dd25bf-ae6d-42e2-87b0-45b7f6eaca8e service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.146850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-25970849-0ed2-49e5-85b3-f9a388ecf8b7 req-a5dd25bf-ae6d-42e2-87b0-45b7f6eaca8e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.147363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-25970849-0ed2-49e5-85b3-f9a388ecf8b7 req-a5dd25bf-ae6d-42e2-87b0-45b7f6eaca8e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.162022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-25970849-0ed2-49e5-85b3-f9a388ecf8b7 req-a5dd25bf-ae6d-42e2-87b0-45b7f6eaca8e service nova] Creating event network-vif-deleted:d1ec8ac2-e17b-4798-b8fc-fe46228d109e for instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 on hv-cinder-85426 Aug 24 05:51:35.167890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-25970849-0ed2-49e5-85b3-f9a388ecf8b7 req-a5dd25bf-ae6d-42e2-87b0-45b7f6eaca8e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038755 Aug 24 05:51:35.168795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 382/808] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:35.333775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:35.334387 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:35.341012 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.341493 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.341951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.342762 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.343566 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.344581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.379752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:35.380681 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:35.381072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:35.381515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lazy-loading 'fault' on Instance uuid 3a2e0976-7c32-4f6c-a456-66c19a291d92 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:35.431380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:35.439748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7c9fcdc6-a4a8-47e2-906d-52af94272653 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 200 len: 1331 microversion: 2.1 time: 0.110762 Aug 24 05:51:35.440322 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 427/809] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:35 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:36.462476 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:36.463253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:36.470112 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:36.470597 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:36.471037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:36.471733 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:36.472188 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:36.472619 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:36.486895 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 HTTP/1.1 Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:51:36.488534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:51:36.489951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '3a2e0976-7c32-4f6c-a456-66c19a291d92'} Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:36.490715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:51:36.492065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:36.493159 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:36.493159 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4f9b980b-ed41-46c3-a591-4b3625f31ce8 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 404 len: 111 microversion: 2.1 time: 0.034524 Aug 24 05:51:36.493159 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 383/810] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:36 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:51:36.501011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-972260cd-1554-41e0-9a57-a6fc498ded4f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '.version_select at 0x7fa91c3178b0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:36.519005 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-972260cd-1554-41e0-9a57-a6fc498ded4f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039505415" status: 202 len: 0 microversion: 2.1 time: 0.021873 Aug 24 05:51:36.519679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 428/811] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 05:51:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1039505415 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:37.131688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a38b2304-9b9f-4a58-9c7a-61d0eefbc416 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: .version_select at 0x7fa920b6e310>, body: {"keypair": {"name": "tempest-keypair-66780559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM/cU5F/+fDMGlVVgNAnYkWyENxLpRZzC0y059meMLk9O0FXzigMt5twFRF7GHi+P+W3Rgavbmneny+NBHH7HVlPer3Dr/6ojrBtiJ4bxo26FQpwCejVQoI80ItOCwOXw=="}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:37.147205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-a38b2304-9b9f-4a58-9c7a-61d0eefbc416 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:51:37.151010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-a38b2304-9b9f-4a58-9c7a-61d0eefbc416 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'key_pairs'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:51:37.173163 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a38b2304-9b9f-4a58-9c7a-61d0eefbc416 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045362 Aug 24 05:51:37.173801 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 384/812] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:51:37 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:37.528383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:37.528911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:37.536354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:37.536842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:37.537277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:37.538006 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:37.538453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:37.539075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:37.566333 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:37.598787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:37.655799 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-eb9a2031-9fe2-43ee-809d-bc7c90746b23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 204 len: 0 microversion: 2.1 time: 0.130748 Aug 24 05:51:37.656961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 429/813] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:51:37 2022] DELETE /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:51:37.666036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:37.666781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:37.673409 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:37.673925 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:37.674365 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:37.675088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:37.675547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:37.675967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:37.811126 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:37.819358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2462e84f-796b-449f-b454-0bf8c9202a00 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1507 microversion: 2.1 time: 0.158006 Aug 24 05:51:37.819922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 385/814] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:37 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:38.390430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-671067110", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7299e068-1622-4d4b-9084-04ba950ea9f9"}], "security_groups": [{"name": "tempest-securitygroup--1867855604"}], "key_name": "tempest-keypair-66780559", "user_data": "}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:38.492705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] validate_networks() for [('7299e068-1622-4d4b-9084-04ba950ea9f9', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:51:38.840573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:38.841291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:38.848659 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:38.849158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:38.849699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:38.850534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:38.851059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:38.851576 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:38.852399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:51:38.852862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:51:38.853260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:51:38.853692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:51:38.854095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:51:38.864147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:38.864611 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:38.865036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:38.865791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:38.866275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:38.867034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:38.883583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:51:38.887403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Getting quotas for user c8b7cb87296a4ecea0b9ab44a0cbfd2c and project 57dfc5e65dc1412ab199fff503acbfc3. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:51:38.898666 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:51:38.901101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:51:38.949112 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b0d6acde-d42f-43a4-966c-c29aaea46a0c tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563332 Aug 24 05:51:38.949966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 430/815] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:51:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:51:38.961361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-172074a1-1bcb-4ab0-9f50-b0e29c91ad05 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:38.962718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-172074a1-1bcb-4ab0-9f50-b0e29c91ad05 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:38.994923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:39.002934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-631c7f6e-6436-4e49-afb2-eb1681da0ee5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1507 microversion: 2.1 time: 0.166359 Aug 24 05:51:39.013664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 386/816] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:38 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:39.019908 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-172074a1-1bcb-4ab0-9f50-b0e29c91ad05 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:39.027521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-172074a1-1bcb-4ab0-9f50-b0e29c91ad05 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1239 microversion: 2.1 time: 0.069939 Aug 24 05:51:39.028006 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 431/817] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:38 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:40.024181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:40.024950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:40.031932 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:40.032419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:40.032859 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:40.033590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:40.034051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:40.034479 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:40.049093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:40.049736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:40.055914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:40.056401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:40.056855 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:40.057539 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:40.058026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:40.058453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:40.128875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:40.136405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a4657a48-d3c6-4354-84fc-70c93687bdc7 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1243 microversion: 2.1 time: 0.091910 Aug 24 05:51:40.136971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 432/818] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:40 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1243 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:40.183982 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:40.191668 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e81fa174-7f91-41b7-acb8-40b48c97b575 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1507 microversion: 2.1 time: 0.171444 Aug 24 05:51:40.192235 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 387/819] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:40 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:41.156513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:41.157270 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:41.163836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.164325 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.164761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.165458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.166191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.166585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.212277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:41.212987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:41.219906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.220402 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.220896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.221629 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.222246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.222843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.228506 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:41.237386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-66cd5dd2-ecf5-4474-b81b-a6a8c1d8c20d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1297 microversion: 2.1 time: 0.084719 Aug 24 05:51:41.238198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 433/820] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:41 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:41.340730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:41.350795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bbf2c8ec-0d50-4e9c-bc62-c80bb70cfea5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 200 len: 1465 microversion: 2.1 time: 0.142416 Aug 24 05:51:41.351497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 388/821] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:41 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 1465 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:51:41.457385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-08aaea4b-c512-4175-b77a-30ea0a801281 req-e2e598e8-5fef-4a02-8153-6d4c4a34e4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5fa2638-f92b-43b2-b0a8-000e3ab5ad80", "name": "network-vif-deleted", "tag": "70fc4815-0bd1-4410-9f20-00e50e3a8dee"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:41.468880 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-08aaea4b-c512-4175-b77a-30ea0a801281 req-e2e598e8-5fef-4a02-8153-6d4c4a34e4e8 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:41.469372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-08aaea4b-c512-4175-b77a-30ea0a801281 req-e2e598e8-5fef-4a02-8153-6d4c4a34e4e8 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:41.470019 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-08aaea4b-c512-4175-b77a-30ea0a801281 req-e2e598e8-5fef-4a02-8153-6d4c4a34e4e8 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:41.483855 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-08aaea4b-c512-4175-b77a-30ea0a801281 req-e2e598e8-5fef-4a02-8153-6d4c4a34e4e8 service nova] Creating event network-vif-deleted:70fc4815-0bd1-4410-9f20-00e50e3a8dee for instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 on hv-cinder-85426 Aug 24 05:51:41.489585 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-08aaea4b-c512-4175-b77a-30ea0a801281 req-e2e598e8-5fef-4a02-8153-6d4c4a34e4e8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035947 Aug 24 05:51:41.490411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 434/822] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:42.262043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:42.262785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:42.270015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.270493 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.271097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.271824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.272273 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.272693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.373180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:42.373971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: e5fa2638-f92b-43b2-b0a8-000e3ab5ad80] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:42.380778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.381532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.381986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.382665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.383111 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.383531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.397692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] HTTP exception thrown: Instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 could not be found. Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Request method failure captured: Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 HTTP/1.1 Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsdP7Q-t8JRnuv4BFU0EFKbt_HtrMXv561NX0UrC6t-iBOAcNLf5m4dhrd4VtGj3WNb3JuuyIrLxJC09Afr6RfY3LKXcmcuolAwf26AfOMVx8jQxsuDTZYMf7rtd4_ZRgZ8V6YAidgJ7qvXt3Re-KaPSji-ET6Pzsg3lCvUveQavBk Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:51:42.399236 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3726a58288d9455b97e041a2e92f8850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 3d8467cc62d948038690af1fdf5bb96a Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 could not be found. Aug 24 05:51:42.400825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': 'e5fa2638-f92b-43b2-b0a8-000e3ab5ad80'} Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 could not be found. Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:42.401733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 could not be found. Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 could not be found. Aug 24 05:51:42.403159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:51:42.405142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Returning 404 to user: Instance e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:42.405142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d8844f5c-e9f9-4a79-80d5-4ee86fa1092e tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80" status: 404 len: 111 microversion: 2.1 time: 0.032064 Aug 24 05:51:42.405142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 435/823] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:42 2022] GET /compute/v2.1/servers/e5fa2638-f92b-43b2-b0a8-000e3ab5ad80 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:51:42.409715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:42.410589 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:42.416353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.416826 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.417253 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.417955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.418404 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.418822 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.444270 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:42.461383 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:42.469738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-36ee7019-2bba-4301-b883-4dce689a49fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.211528 Aug 24 05:51:42.470411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 389/824] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:42 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:42.524639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-39943ff7-7c11-4c25-a0bd-bf427a27b210 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "DELETE /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 204 len: 0 microversion: 2.1 time: 0.118926 Aug 24 05:51:42.525313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 436/825] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:51:42 2022] DELETE /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:51:42.534758 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:42.535677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:42.542032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.542577 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.543016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.543720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:42.544212 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:42.544638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:42.731054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:42.740911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-06c44be2-940f-4492-a76a-e122c3743e9b tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.210436 Aug 24 05:51:42.741495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 390/826] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:42 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:43.490953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:43.491649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:43.498450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.498735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.499166 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.499852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.500386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.500811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.505404 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-86e5fd90-9d94-4627-8db7-3ea115dbf973 req-19480608-a82e-479d-a0b3-962e7d836983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e181f3-5ec4-4533-9c00-5b3ef8d29259", "tag": "b5028992-a9ce-4b33-922b-3ec5afd6402f"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:43.515723 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-86e5fd90-9d94-4627-8db7-3ea115dbf973 req-19480608-a82e-479d-a0b3-962e7d836983 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.516203 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-86e5fd90-9d94-4627-8db7-3ea115dbf973 req-19480608-a82e-479d-a0b3-962e7d836983 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.516639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-86e5fd90-9d94-4627-8db7-3ea115dbf973 req-19480608-a82e-479d-a0b3-962e7d836983 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.527528 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-86e5fd90-9d94-4627-8db7-3ea115dbf973 req-19480608-a82e-479d-a0b3-962e7d836983 service nova] Creating event network-changed:b5028992-a9ce-4b33-922b-3ec5afd6402f for instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 on hv-cinder-85426 Aug 24 05:51:43.532796 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-86e5fd90-9d94-4627-8db7-3ea115dbf973 req-19480608-a82e-479d-a0b3-962e7d836983 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031011 Aug 24 05:51:43.533383 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 391/827] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:43.628911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:43.636401 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dabddd58-a5d8-4cb0-a25c-23ea956febed tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.149665 Aug 24 05:51:43.636971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 437/828] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:43 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:43.762526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:43.763256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:43.769885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.770368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.770806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.771505 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:43.771959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:43.772384 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:43.906113 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:43.913732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-985e95ea-15e4-4c1f-8134-a0540f2f746a tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.155458 Aug 24 05:51:43.914304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 392/829] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:43 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:44.658649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:44.659294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:44.665970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:44.666454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:44.666890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:44.667577 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:44.668034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:44.668458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:44.800927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:44.808502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-20e7909c-5866-462f-853a-3263067f7178 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.154267 Aug 24 05:51:44.809067 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 438/830] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:44 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:44.934531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:44.935104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:44.941519 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:44.942028 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:44.942469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:44.943190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:44.943646 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:44.944071 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:45.071784 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:45.079783 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5189c599-a33f-483c-ab75-cba22ebce870 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.149268 Aug 24 05:51:45.080349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 393/831] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:44 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:45.828272 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:45.828963 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:45.835338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:45.835823 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:45.836256 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:45.836954 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:45.837410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:45.837863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:45.970559 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:45.978545 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-87abef99-ba7f-4682-95b1-cb32a0c34fd1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.154103 Aug 24 05:51:45.979439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 439/832] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:45 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:46.101069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:46.101691 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:46.108249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:46.109699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:46.110171 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:46.110894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:46.111354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:46.111782 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:46.348246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-518295a2-7b59-4ecd-a865-0dc92eb8cd8b req-1bbd4fd5-a6c7-404c-a6b7-80e74e897185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698069e6-1a88-41db-9ac7-3a8a9dad417b", "name": "network-vif-deleted", "tag": "3c60e261-b383-47d1-b112-4e9820cc8fbd"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:46.358188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-518295a2-7b59-4ecd-a865-0dc92eb8cd8b req-1bbd4fd5-a6c7-404c-a6b7-80e74e897185 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:46.359568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-518295a2-7b59-4ecd-a865-0dc92eb8cd8b req-1bbd4fd5-a6c7-404c-a6b7-80e74e897185 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:46.360209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-518295a2-7b59-4ecd-a865-0dc92eb8cd8b req-1bbd4fd5-a6c7-404c-a6b7-80e74e897185 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:46.371901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-518295a2-7b59-4ecd-a865-0dc92eb8cd8b req-1bbd4fd5-a6c7-404c-a6b7-80e74e897185 service nova] Creating event network-vif-deleted:3c60e261-b383-47d1-b112-4e9820cc8fbd for instance 698069e6-1a88-41db-9ac7-3a8a9dad417b on hv-cinder-85426 Aug 24 05:51:46.377310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-518295a2-7b59-4ecd-a865-0dc92eb8cd8b req-1bbd4fd5-a6c7-404c-a6b7-80e74e897185 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032279 Aug 24 05:51:46.378289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 440/833] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:46.404147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:46.412881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0afe9813-d58e-4a97-8e44-a75647b140f5 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1522 microversion: 2.1 time: 0.315903 Aug 24 05:51:46.413592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 394/834] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:46 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:47.001110 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:47.001827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:47.007823 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.008296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.008719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.009395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.009871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.010286 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.137836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:47.146049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f09a2633-aace-4112-a3c9-b678207cfaef tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.150057 Aug 24 05:51:47.146618 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 441/835] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:46 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:47.435228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:47.435791 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:47.438876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=4 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:47.444617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.445101 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.445538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.446259 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.446711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.447137 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.476810 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:47.477286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:47.477766 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:47.478211 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lazy-loading 'fault' on Instance uuid 698069e6-1a88-41db-9ac7-3a8a9dad417b {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:47.480825 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:47.524335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d8467cc62d948038690af1fdf5bb96a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3726a58288d9455b97e041a2e92f8850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:47.532475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-76c823b2-048f-4f28-a8fc-c8f6573def0f tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 200 len: 1311 microversion: 2.1 time: 0.101228 Aug 24 05:51:47.533038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 395/836] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:47 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:48.166723 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:48.167337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:48.173718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:48.174202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:48.174635 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:48.175324 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:48.175777 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:48.176194 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:48.307876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:48.316568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-94722cea-e8bb-42a2-91d6-0b4054b7a815 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.153723 Aug 24 05:51:48.317142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 442/837] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:48 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:48.552576 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:48.553105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] [instance: 698069e6-1a88-41db-9ac7-3a8a9dad417b] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:48.559475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:48.559952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:48.560377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:48.561058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:48.561502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:48.562523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:48.575334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] HTTP exception thrown: Instance 698069e6-1a88-41db-9ac7-3a8a9dad417b could not be found. Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Request method failure captured: Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b HTTP/1.1 Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsdP7Q-t8JRnuv4BFU0EFKbt_HtrMXv561NX0UrC6t-iBOAcNLf5m4dhrd4VtGj3WNb3JuuyIrLxJC09Afr6RfY3LKXcmcuolAwf26AfOMVx8jQxsuDTZYMf7rtd4_ZRgZ8V6YAidgJ7qvXt3Re-KaPSji-ET6Pzsg3lCvUveQavBk Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:51:48.576928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3726a58288d9455b97e041a2e92f8850"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3726a58288d9455b97e041a2e92f8850"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 3726a58288d9455b97e041a2e92f8850 Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-947550810 Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 3d8467cc62d948038690af1fdf5bb96a Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-ServerRescueNegativeTestJSON-947550810-project Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 698069e6-1a88-41db-9ac7-3a8a9dad417b could not be found. Aug 24 05:51:48.578840 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '698069e6-1a88-41db-9ac7-3a8a9dad417b'} Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698069e6-1a88-41db-9ac7-3a8a9dad417b could not be found. Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:48.579562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698069e6-1a88-41db-9ac7-3a8a9dad417b could not be found. Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698069e6-1a88-41db-9ac7-3a8a9dad417b could not be found. Aug 24 05:51:48.580988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:48.582279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] Returning 404 to user: Instance 698069e6-1a88-41db-9ac7-3a8a9dad417b could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:48.582279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-26024e0e-f510-4f91-83a5-cfa937599e23 tempest-ServerRescueNegativeTestJSON-947550810 tempest-ServerRescueNegativeTestJSON-947550810-project] 10.222.0.73 "GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b" status: 404 len: 111 microversion: 2.1 time: 0.030286 Aug 24 05:51:48.582279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 396/838] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:48 2022] GET /compute/v2.1/servers/698069e6-1a88-41db-9ac7-3a8a9dad417b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:51:49.337917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:49.338431 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:49.340388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:49.341182 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=8 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:49.348310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:49.348792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:49.349238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:49.349961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:49.350416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:49.350840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:49.480259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:49.490176 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7a0155c6-c34d-43a1-b1b3-bae6f886af14 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.156117 Aug 24 05:51:49.491210 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-219008655"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:49.504283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 443/839] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:49 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:49.505407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:49.511637 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:49.512116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:49.512538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:49.513224 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:49.513691 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:49.514107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:49.716099 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.network.security_group_api [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Removing security group 1156758b-697b-4b41-94de-4c4152c50031 from port a5494de2-9b32-433b-9632-7ff022a2fa4d Aug 24 05:51:50.273129 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6a9a73ac-156f-4d5a-a66e-23b753b81284 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/action" status: 202 len: 0 microversion: 2.1 time: 0.785865 Aug 24 05:51:50.276688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 397/840] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:51:49 2022] POST /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/action => generated 0 bytes in 787 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:50.281392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-892b8fc4-2f1a-4170-a49c-69b88fbb9b78 req-408ab4f4-2ad3-40f0-bee3-58b3e37eb11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ce9d76-06ce-40b3-91a3-ccf2af253a09", "tag": "a5494de2-9b32-433b-9632-7ff022a2fa4d"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:50.290740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-892b8fc4-2f1a-4170-a49c-69b88fbb9b78 req-408ab4f4-2ad3-40f0-bee3-58b3e37eb11d service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:50.291454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-892b8fc4-2f1a-4170-a49c-69b88fbb9b78 req-408ab4f4-2ad3-40f0-bee3-58b3e37eb11d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:50.292065 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-892b8fc4-2f1a-4170-a49c-69b88fbb9b78 req-408ab4f4-2ad3-40f0-bee3-58b3e37eb11d service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:50.304528 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-892b8fc4-2f1a-4170-a49c-69b88fbb9b78 req-408ab4f4-2ad3-40f0-bee3-58b3e37eb11d service nova] Creating event network-changed:a5494de2-9b32-433b-9632-7ff022a2fa4d for instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 on hv-cinder-85426 Aug 24 05:51:50.309928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-892b8fc4-2f1a-4170-a49c-69b88fbb9b78 req-408ab4f4-2ad3-40f0-bee3-58b3e37eb11d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032072 Aug 24 05:51:50.311137 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 444/841] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:50.511878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:50.512879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:50.519451 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:50.520272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:50.520950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:50.521892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:50.523140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:50.523677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:50.866546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:50.877621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-702091a2-7d8f-43d8-9c6b-6def2b44211d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.369426 Aug 24 05:51:50.878189 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 398/842] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:50 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:51.837983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:51.839215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:51.847690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:51.848811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:51.849889 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:51.851233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:51.852742 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:51.853409 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:51.944735 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-4610d309-aac1-48b2-9500-44b44fa86e0e req-4acb825f-f475-422e-b664-f4d1ec786415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68ce9d76-06ce-40b3-91a3-ccf2af253a09", "tag": "a5494de2-9b32-433b-9632-7ff022a2fa4d"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:51.952698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:51.959607 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4610d309-aac1-48b2-9500-44b44fa86e0e req-4acb825f-f475-422e-b664-f4d1ec786415 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:51.960078 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4610d309-aac1-48b2-9500-44b44fa86e0e req-4acb825f-f475-422e-b664-f4d1ec786415 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:51.961033 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4610d309-aac1-48b2-9500-44b44fa86e0e req-4acb825f-f475-422e-b664-f4d1ec786415 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:51.983146 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-4610d309-aac1-48b2-9500-44b44fa86e0e req-4acb825f-f475-422e-b664-f4d1ec786415 service nova] Creating event network-changed:a5494de2-9b32-433b-9632-7ff022a2fa4d for instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 on hv-cinder-85426 Aug 24 05:51:51.994748 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-4610d309-aac1-48b2-9500-44b44fa86e0e req-4acb825f-f475-422e-b664-f4d1ec786415 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169269 Aug 24 05:51:51.995907 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 399/843] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:51.997406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lazy-loading 'services' on Instance uuid 68ce9d76-06ce-40b3-91a3-ccf2af253a09 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:52.001827 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:52.002756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:52.009025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.009871 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.010546 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.011482 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.012135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.012836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.126195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ab8ad663-cdca-4b31-a56c-86150b4cb90f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "DELETE /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments/e64ffdee-248b-4d20-a80b-5c7ee31374af" status: 202 len: 0 microversion: 2.1 time: 0.303321 Aug 24 05:51:52.128605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 445/844] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:51:51 2022] DELETE /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments/e64ffdee-248b-4d20-a80b-5c7ee31374af => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:51:52.141128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:52.144718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:52.166937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.167763 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.168857 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.172457 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.183719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.190623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.255221 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-69f14b6a-220b-48ac-8afd-30c9d862ce01 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122399 Aug 24 05:51:52.256414 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 446/845] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:52 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:52.287762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:52.295597 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6454065d-cdca-457a-bb17-e4b3c53bfe9f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.298167 Aug 24 05:51:52.303622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 400/846] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:51 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:52.368881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-0b2eda5f-11c5-41e4-abff-a0d61dcd1a20 req-52ea1c5e-8a1a-4554-8024-bf6973d4dbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e181f3-5ec4-4533-9c00-5b3ef8d29259", "name": "network-vif-plugged", "status": "completed", "tag": "b5028992-a9ce-4b33-922b-3ec5afd6402f"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:52.383765 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-0b2eda5f-11c5-41e4-abff-a0d61dcd1a20 req-52ea1c5e-8a1a-4554-8024-bf6973d4dbc6 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:52.384245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-0b2eda5f-11c5-41e4-abff-a0d61dcd1a20 req-52ea1c5e-8a1a-4554-8024-bf6973d4dbc6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:52.384676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-0b2eda5f-11c5-41e4-abff-a0d61dcd1a20 req-52ea1c5e-8a1a-4554-8024-bf6973d4dbc6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:52.400196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-0b2eda5f-11c5-41e4-abff-a0d61dcd1a20 req-52ea1c5e-8a1a-4554-8024-bf6973d4dbc6 service nova] Creating event network-vif-plugged:b5028992-a9ce-4b33-922b-3ec5afd6402f for instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 on hv-cinder-85426 Aug 24 05:51:52.406974 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-0b2eda5f-11c5-41e4-abff-a0d61dcd1a20 req-52ea1c5e-8a1a-4554-8024-bf6973d4dbc6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147549 Aug 24 05:51:52.407794 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 447/847] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:53.278731 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:53.281956 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:53.289850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:53.293906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:53.294626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:53.295712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:53.296894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:53.298891 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:53.324429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:53.325317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:53.343404 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:53.343922 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:53.344461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:53.345282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:53.346077 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:53.346925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:53.370292 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e59f8d48-6d56-43c4-8856-747a8efcecac tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105477 Aug 24 05:51:53.381816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 401/848] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:51:53 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:51:53.389942 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:53.391721 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:53.402612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:53.403536 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:53.404199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:53.405370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:53.406401 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:53.407036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:53.407638 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:53.528824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] HTTP exception thrown: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 is not attached to volume e64ffdee-248b-4d20-a80b-5c7ee31374af Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Request method failure captured: Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments/e64ffdee-248b-4d20-a80b-5c7ee31374af HTTP/1.1 Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbu4VeSTvYEdknk_KufX9cEN_K3gzhIYsEw5e8vNYC7hFTWQMF4sMXLFW7UggiPVAWMyh-uTbjKPhpArZqK5mrMCQR_PV_wrKxq8KA7GQ5Up2GlVrU2IdwC1JJXEVgEbfB9z_eau6gzMYYpr7cC6NlGJEYrBWzA5J6S02tVMlqgRuKg Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 3d5351c28cfa4491bfa37944aa187737 Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-TestMinimumBasicScenario-189423497 Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:51:53.535135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-TestMinimumBasicScenario-189423497 Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 3d5351c28cfa4491bfa37944aa187737 Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-TestMinimumBasicScenario-189423497 Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-TestMinimumBasicScenario-189423497-project Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 9b5f4bd410b544e29c4c569c225a93ed Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-TestMinimumBasicScenario-189423497-project Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:51:53.536951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 is not attached to volume e64ffdee-248b-4d20-a80b-5c7ee31374af Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'server_id': '68ce9d76-06ce-40b3-91a3-ccf2af253a09', 'id': 'e64ffdee-248b-4d20-a80b-5c7ee31374af'} Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e64ffdee-248b-4d20-a80b-5c7ee31374af. Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:51:53.537977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 is not attached to volume e64ffdee-248b-4d20-a80b-5c7ee31374af Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 is not attached to volume e64ffdee-248b-4d20-a80b-5c7ee31374af Aug 24 05:51:53.540175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:51:53.550198 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Returning 404 to user: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 is not attached to volume e64ffdee-248b-4d20-a80b-5c7ee31374af {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:51:53.551395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-304283ac-93f8-4fbb-9b37-f32c10a410a9 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "DELETE /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments/e64ffdee-248b-4d20-a80b-5c7ee31374af" status: 404 len: 154 microversion: 2.1 time: 0.168196 Aug 24 05:51:53.552584 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 402/849] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:51:53 2022] DELETE /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09/os-volume_attachments/e64ffdee-248b-4d20-a80b-5c7ee31374af => generated 154 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:51:53.633764 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:53.647753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4c74f2ea-7413-4869-9741-dea441c35dbb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.327404 Aug 24 05:51:53.648744 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 448/850] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:53 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:54.669549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:54.670545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:54.678293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.678774 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.679203 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:54.679904 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.680355 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.680775 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:54.749002 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:54.749584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:54.756890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.757454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.757990 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:54.758783 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.759299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.759973 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:54.790476 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:51:54.824147 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:54.834606 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-98667100-46b2-41fe-b22a-5aa136b5c7a2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1365 microversion: 2.1 time: 0.168814 Aug 24 05:51:54.835300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 403/851] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:54 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:54.872465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-152c6eec-097f-4e5d-86f9-bf0f87dffa06 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "DELETE /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 204 len: 0 microversion: 2.1 time: 0.127381 Aug 24 05:51:54.873057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 449/852] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:51:54 2022] DELETE /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:51:54.881777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:54.882243 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:54.888341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.889013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.889448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:54.890798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:54.891256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:54.891672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:55.027031 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:55.039582 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d9113361-5ff5-434a-a99a-7a0615d83205 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1553 microversion: 2.1 time: 0.162118 Aug 24 05:51:55.040276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 404/853] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:54 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:55.863811 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:55.864547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:55.867650 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:51:55.873639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:55.874269 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:55.874873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:55.875802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:55.876361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:55.876881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:56.023541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:56.033442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-07baadc6-c649-4870-8327-717ee7c45388 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1555 microversion: 2.1 time: 0.175529 Aug 24 05:51:56.037833 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 450/854] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:55 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:56.055858 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:56.056886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:56.070435 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:56.071059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:56.072960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:56.073538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:56.074010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:56.074746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:56.075196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:56.077722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:56.084026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:56.084806 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:56.085195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:56.087548 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:56.088275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:56.088859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:56.222852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-87454171-3b33-47a8-a14f-1be742f17be2 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172442 Aug 24 05:51:56.224113 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 405/855] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:51:56 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:51:56.292125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:56.302339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-472c91d0-c3f9-4002-9d01-d76eced07c9f tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1553 microversion: 2.1 time: 0.239228 Aug 24 05:51:56.303225 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 451/856] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:56 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1553 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:57.320810 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-fbc77c77-6aa3-4eb0-a5c6-83fdc4cbab37 req-a19d886e-7675-4858-b66f-3aff3850d53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e181f3-5ec4-4533-9c00-5b3ef8d29259", "tag": "b5028992-a9ce-4b33-922b-3ec5afd6402f"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:57.323149 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:57.323755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:57.331740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:57.332224 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:57.332655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:57.333360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:57.333838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:57.334462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:57.342191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-fbc77c77-6aa3-4eb0-a5c6-83fdc4cbab37 req-a19d886e-7675-4858-b66f-3aff3850d53b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:57.342873 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-fbc77c77-6aa3-4eb0-a5c6-83fdc4cbab37 req-a19d886e-7675-4858-b66f-3aff3850d53b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:57.344514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-fbc77c77-6aa3-4eb0-a5c6-83fdc4cbab37 req-a19d886e-7675-4858-b66f-3aff3850d53b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:57.379573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-fbc77c77-6aa3-4eb0-a5c6-83fdc4cbab37 req-a19d886e-7675-4858-b66f-3aff3850d53b service nova] Creating event network-changed:b5028992-a9ce-4b33-922b-3ec5afd6402f for instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 on hv-cinder-85426 Aug 24 05:51:57.392000 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-fbc77c77-6aa3-4eb0-a5c6-83fdc4cbab37 req-a19d886e-7675-4858-b66f-3aff3850d53b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075666 Aug 24 05:51:57.393760 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 406/857] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:57.666161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:57.679471 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bd9d4509-e625-4c03-a52e-71ca96c29d2d tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1553 microversion: 2.1 time: 0.359685 Aug 24 05:51:57.680416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 452/858] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:57 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:58.406239 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-6419ccce-5434-4306-91a5-8f87daa9e0e3 req-a95f9208-920a-456c-a13a-01f7009ada5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68ce9d76-06ce-40b3-91a3-ccf2af253a09", "name": "network-vif-deleted", "tag": "a5494de2-9b32-433b-9632-7ff022a2fa4d"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:51:58.439475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-6419ccce-5434-4306-91a5-8f87daa9e0e3 req-a95f9208-920a-456c-a13a-01f7009ada5a service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:58.440509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-6419ccce-5434-4306-91a5-8f87daa9e0e3 req-a95f9208-920a-456c-a13a-01f7009ada5a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:58.441596 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-6419ccce-5434-4306-91a5-8f87daa9e0e3 req-a95f9208-920a-456c-a13a-01f7009ada5a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:58.460001 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-6419ccce-5434-4306-91a5-8f87daa9e0e3 req-a95f9208-920a-456c-a13a-01f7009ada5a service nova] Creating event network-vif-deleted:a5494de2-9b32-433b-9632-7ff022a2fa4d for instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 on hv-cinder-85426 Aug 24 05:51:58.466035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-6419ccce-5434-4306-91a5-8f87daa9e0e3 req-a95f9208-920a-456c-a13a-01f7009ada5a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069854 Aug 24 05:51:58.467598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 407/859] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:51:58.700892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:58.702139 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:58.713835 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:58.714327 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:58.714753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:58.715469 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:58.715918 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:58.716349 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:58.774791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:58.775286 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:58.775723 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:58.776176 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lazy-loading 'fault' on Instance uuid 68ce9d76-06ce-40b3-91a3-ccf2af253a09 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:51:58.843317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5f4bd410b544e29c4c569c225a93ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5351c28cfa4491bfa37944aa187737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:51:58.861336 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bf153d1e-7f3e-489a-a474-1c4051fc4fb5 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 200 len: 1348 microversion: 2.1 time: 0.164137 Aug 24 05:51:58.862892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 453/860] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:58 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 1348 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:51:59.885359 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:51:59.886101 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] [instance: 68ce9d76-06ce-40b3-91a3-ccf2af253a09] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:51:59.894225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:59.895715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:59.896311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:51:59.897176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:51:59.897805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:51:59.898499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:00.074229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] HTTP exception thrown: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 could not be found. Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Request method failure captured: Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 HTTP/1.1 Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbu4VeSTvYEdknk_KufX9cEN_K3gzhIYsEw5e8vNYC7hFTWQMF4sMXLFW7UggiPVAWMyh-uTbjKPhpArZqK5mrMCQR_PV_wrKxq8KA7GQ5Up2GlVrU2IdwC1JJXEVgEbfB9z_eau6gzMYYpr7cC6NlGJEYrBWzA5J6S02tVMlqgRuKg Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 3d5351c28cfa4491bfa37944aa187737 Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-TestMinimumBasicScenario-189423497 Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:52:00.075864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/3d5351c28cfa4491bfa37944aa187737"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-TestMinimumBasicScenario-189423497 Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 3d5351c28cfa4491bfa37944aa187737 Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-TestMinimumBasicScenario-189423497 Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-TestMinimumBasicScenario-189423497-project Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 9b5f4bd410b544e29c4c569c225a93ed Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-TestMinimumBasicScenario-189423497-project Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 could not be found. Aug 24 05:52:00.077454 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '68ce9d76-06ce-40b3-91a3-ccf2af253a09'} Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 could not be found. Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:52:00.078978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 could not be found. Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 could not be found. Aug 24 05:52:00.080992 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:52:00.082400 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Returning 404 to user: Instance 68ce9d76-06ce-40b3-91a3-ccf2af253a09 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:52:00.082400 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8d3b9fc1-4350-4ea7-b3b4-ec05e8c980f1 tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09" status: 404 len: 111 microversion: 2.1 time: 0.196317 Aug 24 05:52:00.082400 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 408/861] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:51:59 2022] GET /compute/v2.1/servers/68ce9d76-06ce-40b3-91a3-ccf2af253a09 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:52:00.085708 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-81a14ddf-ac00-46c1-984c-b1076bf483bb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] Calling method '.version_select at 0x7fa91cd6f700>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:00.111941 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-81a14ddf-ac00-46c1-984c-b1076bf483bb tempest-TestMinimumBasicScenario-189423497 tempest-TestMinimumBasicScenario-189423497-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1830396125" status: 202 len: 0 microversion: 2.1 time: 0.029599 Aug 24 05:52:00.113816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 409/862] 10.222.0.73 () {58 vars in 1272 bytes} [Wed Aug 24 05:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1830396125 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:52:00.219344 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5f8468d2-67d4-4272-8232-cf24966dcee3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'create', calling method: .version_select at 0x7fa91c30baf0>, body: {"keypair": {"name": "tempest-keypair-1031354402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ5gl1keHykNOrOqlEhg10pxkCBDlrAj5CxoGo+sgstn76HHsay1DkPf7YJ7VoAdL8cJzYt8YfmGu0DN0pzYE3yd4pHkYecgwpMQMLMHziH/qlpqwnOyC/9dK6rngNi7w=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:00.236232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5f8468d2-67d4-4272-8232-cf24966dcee3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for project b93f8c24b94841168ae2212ae15ecde9. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:52:00.241473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5f8468d2-67d4-4272-8232-cf24966dcee3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for user 962fc6a6c7c04d6f93109c420c5aa6cd and project b93f8c24b94841168ae2212ae15ecde9. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:52:00.266334 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5f8468d2-67d4-4272-8232-cf24966dcee3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217131 Aug 24 05:52:00.267435 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 454/863] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:52:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:52:02.128624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-353449984", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b514a938-5fe8-487d-b4d3-71c1f2e13380"}], "security_groups": [{"name": "tempest-securitygroup--556400045"}], "key_name": "tempest-keypair-1031354402", "user_data": "}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:02.304443 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] validate_networks() for [('b514a938-5fe8-487d-b4d3-71c1f2e13380', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:52:03.099918 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:52:03.100417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:52:03.100895 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:52:03.101360 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:52:03.101809 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:52:03.120132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:03.121076 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:03.121633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:03.122462 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:03.126358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:03.127111 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:03.177446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for project b93f8c24b94841168ae2212ae15ecde9. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:52:03.186229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for user 962fc6a6c7c04d6f93109c420c5aa6cd and project b93f8c24b94841168ae2212ae15ecde9. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:52:03.200502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:52:03.203185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:52:03.262184 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c5d209f6-169a-42c4-95e8-f7fe34d0279b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.138656 Aug 24 05:52:03.264725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 410/864] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:52:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:52:03.274568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-99f97fce-c60e-4792-a0ae-c06672c9404d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:03.275760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-99f97fce-c60e-4792-a0ae-c06672c9404d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:03.394000 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-99f97fce-c60e-4792-a0ae-c06672c9404d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:03.401815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-99f97fce-c60e-4792-a0ae-c06672c9404d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1237 microversion: 2.1 time: 0.131547 Aug 24 05:52:03.402927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 455/865] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:03 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1237 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:04.425406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:04.426047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:04.434526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:04.435290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:04.435767 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:04.436488 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:04.437755 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:04.438190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:04.522214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:04.530079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1030035f-7c00-4968-b438-261434888db9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1289 microversion: 2.1 time: 0.109505 Aug 24 05:52:04.530676 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 411/866] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:04 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1289 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:05.551237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:05.551839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:05.558919 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:05.559463 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:05.559828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:05.561958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:05.562620 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:05.563620 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:05.851447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:05.859947 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1606403a-536c-4bfd-bdf1-d322ab6ee680 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.312388 Aug 24 05:52:05.860459 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 456/867] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:05 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:06.274900 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-8d032f03-16cf-4cab-a8dc-e7f437c0670d req-aff446d6-85aa-4348-add4-a0fc982be041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748a59dc-9754-4a71-9f3d-754a13bf75f4", "tag": "746dad8e-222e-4628-85ee-e98ed9e93dac"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:06.287716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8d032f03-16cf-4cab-a8dc-e7f437c0670d req-aff446d6-85aa-4348-add4-a0fc982be041 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:06.288496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8d032f03-16cf-4cab-a8dc-e7f437c0670d req-aff446d6-85aa-4348-add4-a0fc982be041 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:06.289198 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8d032f03-16cf-4cab-a8dc-e7f437c0670d req-aff446d6-85aa-4348-add4-a0fc982be041 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:06.302684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-8d032f03-16cf-4cab-a8dc-e7f437c0670d req-aff446d6-85aa-4348-add4-a0fc982be041 service nova] Creating event network-changed:746dad8e-222e-4628-85ee-e98ed9e93dac for instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 on hv-cinder-85426 Aug 24 05:52:06.308266 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-8d032f03-16cf-4cab-a8dc-e7f437c0670d req-aff446d6-85aa-4348-add4-a0fc982be041 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046030 Aug 24 05:52:06.309077 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 412/868] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:06.880712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:06.881297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:06.887664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:06.888165 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:06.888816 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:06.889242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:06.890196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:06.890613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:07.087570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:07.097187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d2592a9c-d8db-4469-8fcc-674781ca88ca tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.220220 Aug 24 05:52:07.111549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 457/869] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:06 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:07.622664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:07.623886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:07.631923 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:07.632587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:07.633249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:07.634174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:07.634779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:07.635351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:07.662296 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-481d2862-57cb-45ae-9f4e-c6b5f716b5bb tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/ips" status: 200 len: 152 microversion: 2.20 time: 0.043771 Aug 24 05:52:07.669192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 413/870] 10.222.0.73 () {60 vars in 1289 bytes} [Wed Aug 24 05:52:07 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:52:08.121238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:08.121948 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:08.128895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:08.129372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:08.129892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:08.130581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:08.131029 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:08.131443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:08.275636 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:08.284525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-51dd452c-ff6d-4050-8a85-9884638ced68 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.167102 Aug 24 05:52:08.285103 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 458/871] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:08 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:09.305897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:09.306529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:09.314051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.314540 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.314976 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:09.315682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.316130 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.316550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:09.451741 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:09.460217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9ea6abb5-da22-4d23-9bc7-73725315e8b6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.158373 Aug 24 05:52:09.460782 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 414/872] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:09 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:09.543669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:09.544277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:09.550998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.551545 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.551977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:09.552660 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.553105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.553522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:09.576405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lazy-loading 'flavor' on Instance uuid 31a6fa69-6942-458d-b3a8-7eb647fa331f {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:52:09.751089 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bcd6a44b-3e04-4a5e-b5e0-bf6a04c40546 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/action" status: 202 len: 0 microversion: 2.20 time: 0.211196 Aug 24 05:52:09.751688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 459/873] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 05:52:09 2022] POST /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:52:09.760070 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:09.760683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:09.766869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.767354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.767781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:09.768522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:09.768974 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:09.769393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:10.159139 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:10.167340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:10.168849 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:10.170126 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c678325c-54b5-4122-8adb-6345e2112139 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.414046 Aug 24 05:52:10.171234 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 415/874] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:09 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:10.480998 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:10.481640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:10.488140 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:10.488617 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:10.489052 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:10.489767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:10.490225 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:10.490645 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:10.623337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:10.631152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f45abb0e-11cc-4785-bfe2-cfdd4a187e91 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.154536 Aug 24 05:52:10.631850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 460/875] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:10 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:11.194627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:11.195233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:11.201611 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:11.202088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:11.202520 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:11.203199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:11.203642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:11.204422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:11.338910 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:11.347062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:11.348578 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:11.349788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c58d368c-567f-4375-a821-f8d1837a7978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.159067 Aug 24 05:52:11.350353 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 416/876] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:11 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:11.652814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:11.653781 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:11.660260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:11.660728 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:11.661151 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:11.661859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:11.662306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:11.662720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:11.792441 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:11.800774 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c12543fe-938c-4d6d-b438-505a5f064c54 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.151930 Aug 24 05:52:11.801651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 461/877] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:11 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:12.084269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-59967327-cece-46f4-b194-88c5ce7efa43 req-b3d071ce-383f-45ef-9a0e-04206bebb677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748a59dc-9754-4a71-9f3d-754a13bf75f4", "name": "network-vif-plugged", "status": "completed", "tag": "746dad8e-222e-4628-85ee-e98ed9e93dac"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:12.094278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-59967327-cece-46f4-b194-88c5ce7efa43 req-b3d071ce-383f-45ef-9a0e-04206bebb677 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:12.094784 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-59967327-cece-46f4-b194-88c5ce7efa43 req-b3d071ce-383f-45ef-9a0e-04206bebb677 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:12.095344 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-59967327-cece-46f4-b194-88c5ce7efa43 req-b3d071ce-383f-45ef-9a0e-04206bebb677 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:12.106347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-59967327-cece-46f4-b194-88c5ce7efa43 req-b3d071ce-383f-45ef-9a0e-04206bebb677 service nova] Creating event network-vif-plugged:746dad8e-222e-4628-85ee-e98ed9e93dac for instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 on hv-cinder-85426 Aug 24 05:52:12.111356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-59967327-cece-46f4-b194-88c5ce7efa43 req-b3d071ce-383f-45ef-9a0e-04206bebb677 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030718 Aug 24 05:52:12.111937 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 417/878] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:12.372254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:12.372883 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:12.378845 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:12.379317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:12.379741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:12.380421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:12.380866 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:12.381304 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:12.507655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:12.509952 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:12.517676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:12.519190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:12.520346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a7c770ca-8dae-450f-b6f5-616f10667716 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.151989 Aug 24 05:52:12.520916 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 462/879] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:12 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:12.823026 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:12.823726 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:12.830487 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:12.830970 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:12.831410 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:12.832105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:12.832558 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:12.832989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:12.963595 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:12.972024 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a6c92add-aa61-4328-8324-8a3e24f4a3fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.153699 Aug 24 05:52:12.972590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 418/880] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:12 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:13.544001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:13.544606 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:13.547456 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=6 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:13.554176 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:13.554690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:13.555123 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:13.555810 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:13.556263 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:13.556686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:13.685447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:13.694620 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:13.696126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:13.697280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-971422fc-b4c6-4a50-8b37-cef393a1c0a7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.157541 Aug 24 05:52:13.697895 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 463/881] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:13 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:13.993058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:13.993704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:13.995589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:13.996242 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=6 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:14.002621 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:14.003095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:14.003528 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:14.004214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:14.004660 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:14.005079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:14.022946 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:14.138105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:14.145836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4f37df5e-b9e9-48e0-adf7-e5ca7fd03875 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1362 microversion: 2.1 time: 0.156613 Aug 24 05:52:14.146399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 419/882] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:13 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:14.720694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:14.721284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:14.727633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:14.728106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:14.728538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:14.729220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:14.729691 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:14.730112 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:14.859354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:14.867353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:14.868850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:14.870024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-52e6f8bd-4d6d-4059-8f96-217df50e2b68 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.153533 Aug 24 05:52:14.870583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 464/883] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:14 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:15.166981 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:15.167647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:15.174569 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.175043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.175470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:15.176151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.176594 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.177008 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:15.309609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:15.317273 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8c975d07-3415-407a-b949-076ce905b299 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1547 microversion: 2.1 time: 0.154123 Aug 24 05:52:15.317969 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 420/884] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:15 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:15.338488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:15.338975 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:15.345475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.345985 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.346412 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:15.347099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.347546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.347964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:15.569652 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6d0e2704-f941-4398-b0fd-25fc5a10f431 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.234871 Aug 24 05:52:15.570244 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 465/885] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:52:15 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:15.893929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:15.894661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:15.900865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.901449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.901916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:15.902616 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:15.903072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:15.903503 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:16.032704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:16.041008 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:16.042574 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:16.043756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9f87cd25-1139-42ee-86c5-c164915687f4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.154288 Aug 24 05:52:16.044321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 421/886] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:15 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:16.664495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-6188521c-0ed6-4ad3-9639-23defee7fef5 req-788d23e9-a6e2-4314-a11f-c30081278e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "748a59dc-9754-4a71-9f3d-754a13bf75f4", "tag": "746dad8e-222e-4628-85ee-e98ed9e93dac"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:16.674664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-6188521c-0ed6-4ad3-9639-23defee7fef5 req-788d23e9-a6e2-4314-a11f-c30081278e03 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:16.675171 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-6188521c-0ed6-4ad3-9639-23defee7fef5 req-788d23e9-a6e2-4314-a11f-c30081278e03 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:16.675603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-6188521c-0ed6-4ad3-9639-23defee7fef5 req-788d23e9-a6e2-4314-a11f-c30081278e03 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:16.687406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-6188521c-0ed6-4ad3-9639-23defee7fef5 req-788d23e9-a6e2-4314-a11f-c30081278e03 service nova] Creating event network-changed:746dad8e-222e-4628-85ee-e98ed9e93dac for instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 on hv-cinder-85426 Aug 24 05:52:16.692225 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-6188521c-0ed6-4ad3-9639-23defee7fef5 req-788d23e9-a6e2-4314-a11f-c30081278e03 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031809 Aug 24 05:52:16.693190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 466/887] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:17.067737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:17.068396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:17.075120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:17.075604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:17.076098 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:17.076795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:17.077246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:17.077796 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:17.335595 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:17.344603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:17.346290 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:17.347523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f5dc09ad-0b84-43b4-82dc-04c3d4ae8f0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.284454 Aug 24 05:52:17.361553 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 422/888] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:17 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:18.371623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:18.372311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:18.378535 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:18.379006 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:18.379430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:18.380101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:18.380547 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:18.380958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:18.507825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:18.515915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:18.517411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:18.518581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-46d4dde9-9836-4348-9cea-9e4176a432ad tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.151666 Aug 24 05:52:18.519128 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 467/889] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:18 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:52:19.542053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:19.542656 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:19.549819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:19.550293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:19.550725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:19.551406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:19.551848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:19.552263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:19.679119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:19.687826 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:19.689345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:19.690547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7b913b56-de96-4dd6-996a-7e3f18cb7f53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.152466 Aug 24 05:52:19.691104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 423/890] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:19 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:20.713403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:20.714037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:20.720444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:20.720924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:20.721356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:20.722066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:20.722520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:20.722941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:20.856570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:20.864956 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:20.866502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:20.867662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9eab5566-5697-49bb-85aa-ab41ebf27cba tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.158294 Aug 24 05:52:20.868215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 468/891] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:20 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:21.891742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:21.892390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:21.898818 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:21.899301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:21.900432 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:21.900432 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:21.900850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:21.901300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:22.030224 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:22.038409 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:22.039913 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:22.041076 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-63b7d487-0a2a-4a9c-993c-8b5630aacda4 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.153773 Aug 24 05:52:22.041724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 424/892] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:21 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:23.064250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:23.064824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:23.070864 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:23.071338 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:23.071771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:23.072450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:23.072899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:23.073322 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:23.198568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:23.207368 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:23.208870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:23.210051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4be1379c-758d-4987-94a0-5f34affee0fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.149836 Aug 24 05:52:23.210608 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 469/893] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:23 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:24.233850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:24.234468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:24.236894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:24.243036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:24.243560 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:24.244105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:24.244800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:24.245253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:24.245714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:24.380139 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:24.388105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:24.389628 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:24.390777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5bdbc758-bb92-41ba-a447-c39d0207c2a5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.161730 Aug 24 05:52:24.391330 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 425/894] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:24 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:25.414221 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:25.414814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:25.422268 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:25.422747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:25.423179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:25.423863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:25.424314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:25.424735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:25.554068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:25.562789 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:25.564279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:25.565430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9df9721d-4e16-4f3f-b7fe-c65dbc496c36 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1744 microversion: 2.20 time: 0.155087 Aug 24 05:52:25.566011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 470/895] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:25 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:26.588494 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:26.589114 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:26.596456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:26.596944 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:26.597385 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:26.598115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:26.598569 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:26.598993 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:26.728512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:26.736878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:26.738419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:26.739581 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c347ae79-ce41-4549-a2e0-97e60b7aedd8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1744 microversion: 2.20 time: 0.155098 Aug 24 05:52:26.740143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 426/896] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:26 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:27.068654 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:27.069205 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:27.071543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:27.076584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:27.077107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:27.077535 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:27.078237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:27.078684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:27.079101 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:27.103130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lazy-loading 'flavor' on Instance uuid 977405bb-cdcc-4b20-b7ae-754ab660c7c3 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:52:27.172946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8013b157-b694-4401-88b3-894937f053d2 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "POST /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3/action" status: 202 len: 0 microversion: 2.1 time: 0.107952 Aug 24 05:52:27.173549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 471/897] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:52:27 2022] POST /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:52:27.181757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:27.182429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:27.189444 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:27.190293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:27.190384 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:27.191150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:27.192058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:27.192218 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:27.326124 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:27.333885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-31c45c4b-e0d9-4b72-a70e-d4d85e690177 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.155993 Aug 24 05:52:27.334455 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 427/898] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:27 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:27.763355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:27.765651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:27.771693 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:27.772164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:27.772587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:27.773259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:27.773738 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:27.774153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:27.903079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:27.912009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:27.913589 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:27.915131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-98a88275-9b9a-475e-9f2f-adcdfae4cec3 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1744 microversion: 2.20 time: 0.156006 Aug 24 05:52:27.915675 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 472/899] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:27 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:28.356234 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:28.356996 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:28.363763 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:28.364245 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:28.364869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:28.365597 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:28.366057 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:28.366684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:28.524585 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:28.533678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-469bd55b-9bca-49bb-aabb-f7f1dbf2cf06 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.181348 Aug 24 05:52:28.534587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 428/900] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:28 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:28.939093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:28.939708 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:28.946616 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:28.947094 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:28.947700 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:28.948591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:28.949040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:28.949460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:29.098206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:29.107001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:29.111513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:29.113009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-442578d5-e53c-4020-a8d1-0ea9183be016 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.178725 Aug 24 05:52:29.113578 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 473/901] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:28 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:29.559296 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:29.559931 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:29.567325 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:29.569181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:29.570234 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:29.571166 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:29.571790 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:29.572394 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:29.735115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:29.743523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-081a1155-5807-4336-b40e-cb3723b4f55e tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.188440 Aug 24 05:52:29.744588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 429/902] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:29 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:30.139238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:30.139839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:30.149671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:30.150160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:30.150593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:30.151430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:30.151943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:30.153159 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:30.182399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-3f1132e1-34f4-4ec0-83a0-a5735fafb1eb req-ef6166a8-e074-4b97-a861-e4e66b7ae623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6fa69-6942-458d-b3a8-7eb647fa331f", "name": "network-vif-plugged", "status": "completed", "tag": "3088fe36-419f-41a4-bcd1-c2ce02a2cd29"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:30.192728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3f1132e1-34f4-4ec0-83a0-a5735fafb1eb req-ef6166a8-e074-4b97-a861-e4e66b7ae623 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:30.193219 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3f1132e1-34f4-4ec0-83a0-a5735fafb1eb req-ef6166a8-e074-4b97-a861-e4e66b7ae623 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:30.193681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-3f1132e1-34f4-4ec0-83a0-a5735fafb1eb req-ef6166a8-e074-4b97-a861-e4e66b7ae623 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:30.208950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-3f1132e1-34f4-4ec0-83a0-a5735fafb1eb req-ef6166a8-e074-4b97-a861-e4e66b7ae623 service nova] Creating event network-vif-plugged:3088fe36-419f-41a4-bcd1-c2ce02a2cd29 for instance 31a6fa69-6942-458d-b3a8-7eb647fa331f on hv-cinder-85426 Aug 24 05:52:30.216493 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-3f1132e1-34f4-4ec0-83a0-a5735fafb1eb req-ef6166a8-e074-4b97-a861-e4e66b7ae623 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038564 Aug 24 05:52:30.218013 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 430/903] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:30.306465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:30.318568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:30.320444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:30.321853 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1f7e23e6-c44b-4422-ab8b-e687cebb36b6 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.188328 Aug 24 05:52:30.322600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 474/904] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:30 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:30.766123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:30.766934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:30.773429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:30.773953 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:30.774389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:30.775098 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:30.775551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:30.776358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:30.922199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:30.930300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-03299b95-3629-4e51-abc6-f8510b5845fb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.169596 Aug 24 05:52:30.931097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 431/905] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:30 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:31.349122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:31.349760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:31.356757 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:31.357250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:31.358518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:31.359399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:31.360678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:31.361116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:31.517590 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:31.527027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:31.528820 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:31.530473 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ea522d1e-331d-4612-b328-2c60c572dd42 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.185297 Aug 24 05:52:31.531565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 475/906] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:31 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:31.952071 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:31.952921 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:31.960646 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:31.961370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:31.961852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:31.962558 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:31.963177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:31.963773 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:32.126041 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:32.134351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c76fd713-748d-430c-aec0-6c143469d48b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.186391 Aug 24 05:52:32.135323 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 432/907] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:31 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:32.555967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:32.556970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:32.563494 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:32.564291 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:32.564916 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:32.565970 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:32.566615 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:32.567033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:32.727388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:32.737701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:32.739602 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:32.740875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-88a509e6-ddc0-46ca-8894-f72f2fa80e76 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.188923 Aug 24 05:52:32.741517 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 476/908] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:32 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:33.158679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:33.159880 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:33.166858 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:33.167341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:33.167772 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:33.168552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:33.169012 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:33.169496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:33.331947 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:33.340311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6dc4a217-fd96-4fb8-aca0-c563c8eacaf1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.186216 Aug 24 05:52:33.341062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 433/909] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:33 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:33.764513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:33.765798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:33.772935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:33.773671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:33.774266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:33.775126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:33.775742 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:33.776444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:33.944848 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:33.959874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:33.963299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:33.965248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-61830f27-f85d-4ab3-9a01-2b1f17aeeb53 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.204433 Aug 24 05:52:33.966245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 477/910] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:33 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:34.362479 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:34.363185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:34.372412 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:34.373497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:34.374029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:34.374730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:34.375176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:34.375618 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:34.528609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:34.536989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0ece0d30-65f0-4e0e-8ef4-f49b8edd0a03 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.178701 Aug 24 05:52:34.549777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 434/911] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:34 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:34.567478 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:34.567969 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:34.577011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:34.577011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:34.577011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:34.577011 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:34.577405 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:34.578175 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:34.592108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:34.602537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ccbb12f9-80df-47ba-8aa7-e2b534daf7c5 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/ips" status: 200 len: 150 microversion: 2.1 time: 0.038888 Aug 24 05:52:34.603303 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 478/912] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:52:34 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:34.988983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:34.991596 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:35.002048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:35.002746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:35.003368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:35.004376 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:35.005003 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:35.005433 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:35.177329 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:35.186350 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:35.188207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:35.191678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-aa99e1d1-22c0-4a4c-9a2f-ddb8544b7362 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.206873 Aug 24 05:52:35.192467 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 435/913] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:34 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:35.559685 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:35.560992 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:35.568928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:35.569412 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:35.570056 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:35.570763 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:35.571214 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:35.571747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:35.716037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:35.724306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8650cde5-32f7-406c-8a70-383157435d7b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.168702 Aug 24 05:52:35.725086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 479/914] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:35 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:36.006228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0028ec3-2301-4804-bcf9-e461e7adfe57"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:36.008666 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:36.016590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:36.017187 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:36.017650 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:36.018374 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:36.018831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:36.019263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:36.122523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=100 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:36.217071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:36.217789 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:36.224967 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:36.225621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:36.226482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:36.227282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:36.227829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:36.228360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:36.389761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:36.405946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:36.409786 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:36.413499 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-27047dff-1ea9-4127-b7bc-747063531331 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.200588 Aug 24 05:52:36.415971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 480/915] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:36 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:52:36.513022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2b06a682-daf7-46b2-b9c5-244818c55a51 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "POST /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511146 Aug 24 05:52:36.514452 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 436/916] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:52:36 2022] POST /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:36.747383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:36.748724 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:36.758285 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:36.762668 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:36.764316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:36.765367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:36.766016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:36.767449 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:36.925501 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:36.933950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4f00ccfc-9490-40fa-9565-dafa76cd0d74 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.190767 Aug 24 05:52:36.934822 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 481/917] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:36 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:37.440120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:37.440816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:37.446985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:37.447456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:37.447886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:37.448563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:37.449006 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:37.449422 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:37.578120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:37.586144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:37.587648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:37.589176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-07580018-a14d-4ba5-af29-a7bcec1e7639 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1739 microversion: 2.20 time: 0.153468 Aug 24 05:52:37.589625 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 437/918] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:37 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:37.956756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:37.957342 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:37.963938 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:37.964414 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:37.964844 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:37.965532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:37.966006 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:37.966432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:38.105315 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:38.113586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-acb79be2-57cc-4fd8-ab09-b63d4bdd599b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.161462 Aug 24 05:52:38.114283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 482/919] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:37 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:38.613110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:38.613742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:38.620036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:38.620511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:38.620938 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:38.621649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:38.622095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:38.622512 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:38.929586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:38.938123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:38.939642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:38.940823 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7e44ecb0-dbdb-4d7a-a8d6-2215b2f7e3b7 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1721 microversion: 2.20 time: 0.331620 Aug 24 05:52:38.941954 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 438/920] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:38 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1721 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:52:39.134870 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:39.135411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:39.142323 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:39.142812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:39.143245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:39.143936 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:39.144391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:39.144814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:39.273259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:39.282413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4d7bf00f-6197-4c55-ac24-8c6f6400c2ae tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.151542 Aug 24 05:52:39.282978 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 483/921] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:39 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:39.964679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:39.965215 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:39.971712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:39.972196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:39.972631 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:39.973322 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:39.973806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:39.974232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:40.105892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:40.115201 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:40.116729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:40.117922 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1dee31f0-edb6-4501-bc01-cf12e0314aae tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1721 microversion: 2.20 time: 0.157241 Aug 24 05:52:40.118489 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 439/922] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:39 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:40.303616 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:40.304222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:40.310631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:40.311107 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:40.311533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:40.312217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:40.312663 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:40.313080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:40.448288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:40.456851 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f7b1273f-9357-48d8-990b-11820ce8ffed tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.157063 Aug 24 05:52:40.457428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 484/923] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:40 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:41.141526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:41.142240 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:41.148724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:41.149210 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:41.149684 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:41.150383 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:41.150838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:41.151264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:41.277417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:41.285591 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:41.287110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:41.288277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e2c4ac5e-a1ad-442f-9ba1-e4d3288e8bdd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1721 microversion: 2.20 time: 0.151529 Aug 24 05:52:41.288841 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 440/924] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:41 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:41.478462 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:41.479005 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:41.486237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:41.486714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:41.487145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:41.487827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:41.488277 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:41.488697 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:41.617171 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:41.624792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c72a8749-c59f-435c-a1ba-1b7df92384c4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.150261 Aug 24 05:52:41.625352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 485/925] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:41 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:42.189797 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-02e46aee-b026-4c91-a09b-7e51bba0990e req-a65f8e4e-573b-478f-84a4-8aabecebbc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6fa69-6942-458d-b3a8-7eb647fa331f", "name": "network-vif-unplugged", "status": "completed", "tag": "3088fe36-419f-41a4-bcd1-c2ce02a2cd29"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:42.200333 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-02e46aee-b026-4c91-a09b-7e51bba0990e req-a65f8e4e-573b-478f-84a4-8aabecebbc28 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:42.200819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-02e46aee-b026-4c91-a09b-7e51bba0990e req-a65f8e4e-573b-478f-84a4-8aabecebbc28 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:42.201252 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-02e46aee-b026-4c91-a09b-7e51bba0990e req-a65f8e4e-573b-478f-84a4-8aabecebbc28 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:42.213163 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-02e46aee-b026-4c91-a09b-7e51bba0990e req-a65f8e4e-573b-478f-84a4-8aabecebbc28 service nova] Creating event network-vif-unplugged:3088fe36-419f-41a4-bcd1-c2ce02a2cd29 for instance 31a6fa69-6942-458d-b3a8-7eb647fa331f on hv-cinder-85426 Aug 24 05:52:42.218772 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-02e46aee-b026-4c91-a09b-7e51bba0990e req-a65f8e4e-573b-478f-84a4-8aabecebbc28 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033464 Aug 24 05:52:42.219348 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 441/926] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:52:42.312506 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:42.313131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:42.319336 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:42.319814 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:42.320235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:42.320929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:42.321373 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:42.321842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:42.456683 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:42.464693 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:42.466224 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:42.467413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3e66c45e-d2c2-42cc-b403-c4d0a80bd1f0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1721 microversion: 2.20 time: 0.159602 Aug 24 05:52:42.468002 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 486/927] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:42 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:52:42.646766 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:42.647455 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:42.654261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:42.654854 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:42.655447 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:42.656162 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:42.656651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:42.657082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:42.796864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:42.806103 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1e3898e3-7cc2-4c09-a38a-8e40ed2f07dd tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.163380 Aug 24 05:52:42.807266 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 442/928] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:42 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:43.489980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:43.490577 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:43.497688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:43.502836 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:43.503352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:43.504161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:43.504625 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:43.505052 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:43.647684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:43.657443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:43.658977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:43.660131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-918ba538-9de0-4e59-bc6a-baeb637ef970 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1664 microversion: 2.20 time: 0.174019 Aug 24 05:52:43.660688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 487/929] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:43 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:43.682233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a88717b6-703d-495f-9087-7db13fc2f38e"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:43.684747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:43.691083 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:43.691586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:43.692020 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:43.692706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:43.693156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:43.693587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:43.829610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:43.830382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:43.837382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:43.837923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:43.838352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:43.839040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:43.839668 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:43.840083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:43.990677 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:44.003690 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6f9df2e4-5499-46c3-8489-25ea61e82aec tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1570 microversion: 2.1 time: 0.178616 Aug 24 05:52:44.004876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 488/930] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:43 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:52:44.025732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:44.026329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:44.033051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.033992 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.034682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.035136 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.035552 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.043023 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a984d06b-cb8d-4ca3-8c98-79936e9cb1c0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.364525 Aug 24 05:52:44.049854 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 443/931] 10.222.0.73 () {62 vars in 1364 bytes} [Wed Aug 24 05:52:43 2022] POST /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-volume_attachments => generated 188 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:52:44.082068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127194) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:52:44.160521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ae66f08a-9e23-473d-a965-8dbfc7228f3d tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "POST /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3/action" status: 202 len: 0 microversion: 2.1 time: 0.138664 Aug 24 05:52:44.164009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 489/932] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:52:44 2022] POST /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:52:44.171286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:44.172378 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:44.183794 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.184565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.185289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.186598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.187297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.187784 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.192217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:44.192714 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:44.204555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.205059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.205491 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.206543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.210378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.210769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.424898 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:44.435043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8c7a3431-1509-4911-ba84-74e2200ebfc5 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1578 microversion: 2.1 time: 0.269117 Aug 24 05:52:44.435790 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 444/933] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:44 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1578 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:44.442620 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:44.443199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:44.450882 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.451927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.453858 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.455213 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.455688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.456425 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.509540 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f6006499-c281-4b54-95b4-a1e63d149a99 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-volume_attachments/a88717b6-703d-495f-9087-7db13fc2f38e" status: 202 len: 0 microversion: 2.20 time: 0.321609 Aug 24 05:52:44.510461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 490/934] 10.222.0.73 () {60 vars in 1457 bytes} [Wed Aug 24 05:52:44 2022] DELETE /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-volume_attachments/a88717b6-703d-495f-9087-7db13fc2f38e => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:52:44.552116 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lazy-loading 'services' on Instance uuid b4e181f3-5ec4-4533-9c00-5b3ef8d29259 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:52:44.572448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:44.573134 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:44.579847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.580327 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.580753 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.581442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.581912 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.582513 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.618511 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127194) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:52:44.638603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-095be084-c9bc-4f56-b14a-e03e26e50108 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments/b0028ec3-2301-4804-bcf9-e461e7adfe57" status: 202 len: 0 microversion: 2.1 time: 0.199561 Aug 24 05:52:44.639360 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 445/935] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:52:44 2022] DELETE /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments/b0028ec3-2301-4804-bcf9-e461e7adfe57 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:52:44.648813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:44.651393 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:44.653885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:44.661884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.662636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.663242 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.664263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.664907 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.665359 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.697072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8c4660e7-f0ce-4cc0-ad62-8dc3fa4b2809 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051884 Aug 24 05:52:44.697769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9bfdf5d8-1035-4ffd-b1f4-f8d3fa166150 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "POST /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/action" status: 202 len: 0 microversion: 2.20 time: 0.129527 Aug 24 05:52:44.698442 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 491/936] 10.222.0.73 () {62 vars in 1319 bytes} [Wed Aug 24 05:52:44 2022] POST /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:52:44.701371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 446/937] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:52:44 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:52:44.710124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:44.710793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:44.718096 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.718718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.719340 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.720125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:44.720977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:44.721505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:44.884830 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:44.893354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:44.894899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:44.896061 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4df8fe02-e259-4b0f-a131-80046279a55a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1672 microversion: 2.20 time: 0.189807 Aug 24 05:52:44.896799 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 492/938] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:44 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1672 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:52:45.456985 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:45.458017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:45.463931 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.464488 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.465037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.466029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.466563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.467071 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.608821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:45.618266 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c4eb7ad8-fcf1-426d-bb0e-e5f477274d23 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1520 microversion: 2.1 time: 0.165859 Aug 24 05:52:45.619127 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 447/939] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:45 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:45.709537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:45.711871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:45.719153 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.719626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.720050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.720735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.721178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.721613 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.750451 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0e7fc733-bf94-4bca-9a9a-e11432d24733 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044735 Aug 24 05:52:45.751001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 493/940] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:52:45 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:52:45.815209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:45.815780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:45.822128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.822608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.823049 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.824416 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.824884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.825507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.853857 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:52:45.883060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:45.919182 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:45.919827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:45.925911 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.926398 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.926886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.927554 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.928010 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.928511 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.936448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8b276256-a352-4616-a289-3573c88b5934 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 204 len: 0 microversion: 2.1 time: 0.125368 Aug 24 05:52:45.937456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 448/941] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:52:45 2022] DELETE /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:52:45.946814 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:45.947977 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:45.956571 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.957056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.957492 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:45.958275 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:45.958671 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:45.959091 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:46.069733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:46.080162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:46.081709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:46.083172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-34737098-5a98-47f5-9e4a-3a849f0039a2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1674 microversion: 2.20 time: 0.168163 Aug 24 05:52:46.083928 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 494/942] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:45 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:52:46.112034 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:46.120933 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-96ee42fc-e0a7-4609-950d-8a81e6d15962 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1680 microversion: 2.1 time: 0.178872 Aug 24 05:52:46.122076 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 449/943] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:45 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:46.178403 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-955c8ac6-9ecf-4278-8430-bf4167c754aa req-1b2d6235-4a34-449d-a045-069b66a4df60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "977405bb-cdcc-4b20-b7ae-754ab660c7c3", "name": "network-vif-unplugged", "status": "completed", "tag": "477bcaf5-dea4-412c-a5c0-a5d8080b11f0"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:46.188913 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-955c8ac6-9ecf-4278-8430-bf4167c754aa req-1b2d6235-4a34-449d-a045-069b66a4df60 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:46.189388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-955c8ac6-9ecf-4278-8430-bf4167c754aa req-1b2d6235-4a34-449d-a045-069b66a4df60 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:46.190399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-955c8ac6-9ecf-4278-8430-bf4167c754aa req-1b2d6235-4a34-449d-a045-069b66a4df60 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:46.201831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.compute.server_external_events [req-955c8ac6-9ecf-4278-8430-bf4167c754aa req-1b2d6235-4a34-449d-a045-069b66a4df60 service nova] Unable to find a host for instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3. Dropping event network-vif-unplugged {{(pid=127194) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 05:52:46.203281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-955c8ac6-9ecf-4278-8430-bf4167c754aa req-1b2d6235-4a34-449d-a045-069b66a4df60 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028183 Aug 24 05:52:46.203871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 495/944] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 05:52:46.640058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:46.640678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:46.646665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:46.647144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:46.647577 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:46.648410 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:46.648875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:46.649300 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:46.776830 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:46.785238 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5982928a-d8e4-44af-8f1a-9f461da2e81b tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1520 microversion: 2.1 time: 0.149042 Aug 24 05:52:46.785839 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 450/945] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:46 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:47.115802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:47.116409 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:47.122776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:47.123246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:47.123675 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:47.124351 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:47.124794 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:47.125206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:47.143442 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:47.144061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:47.150340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:47.150824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:47.151261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:47.151951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:47.152463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:47.153154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:47.263560 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:47.272400 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:47.273968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:47.275142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8219fd69-6ee7-4390-8713-5822aa8a4f3d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1674 microversion: 2.20 time: 0.163172 Aug 24 05:52:47.275695 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 496/946] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:47 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:47.286354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:47.293996 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3b789877-f4be-4546-b335-4754f78f15e0 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1680 microversion: 2.1 time: 0.154892 Aug 24 05:52:47.294548 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 451/947] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:47 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:52:47.807301 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:47.807837 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:47.814268 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:47.814747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:47.815179 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:47.815862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:47.816313 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:47.816734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:47.947549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:47.955411 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b15b1402-e433-4277-ac4c-575c18917c60 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1520 microversion: 2.1 time: 0.152239 Aug 24 05:52:47.955985 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 497/948] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:47 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:48.300677 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:48.301297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:48.307332 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:48.307815 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:48.308256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:48.308970 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:48.309655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:48.309960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:48.314997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:48.316201 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:48.323677 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:48.324168 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:48.324601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:48.325307 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:48.325796 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:48.326218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:48.463676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:48.472185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8ed68716-e8d8-4602-98d0-29a8cb17928a tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1680 microversion: 2.1 time: 0.161204 Aug 24 05:52:48.477647 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 498/949] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:48 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:48.887322 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:48.895713 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:48.897261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:48.898441 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ded20fef-bb84-47dc-80dd-0807f392ed8e tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.603749 Aug 24 05:52:48.899022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 452/950] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:48 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:48.976229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:48.976867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:48.983098 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:48.983878 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:48.984310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:48.985534 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:48.986023 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:48.986498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:49.120720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:49.129782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8810182f-27a8-4b41-8e72-bd26136de131 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.157341 Aug 24 05:52:49.130361 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 499/951] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:48 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:49.494427 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:49.495121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:49.502326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:49.502888 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:49.503327 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:49.504039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:49.504479 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:49.504898 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:49.628747 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:49.635169 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bef25967-5412-44cd-858c-dca1e8a6a14d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.144777 Aug 24 05:52:49.635743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 453/952] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:49 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:49.924097 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:49.925417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:49.943051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:49.943884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:49.944527 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:49.945475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:49.946077 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:49.946712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:50.090588 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:50.099360 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:50.100852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:50.102105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-362a2197-336d-42e9-9e57-5598b7cfdc84 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.182903 Aug 24 05:52:50.102662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 500/953] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:49 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:50.151347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:50.152140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:50.159501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:50.162303 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:50.165103 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:50.166123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:50.166699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:50.167942 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:50.185588 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-0c9fc8b4-b6b2-4c5b-a36a-e5678dfc4af4 req-fb641319-dac4-4fdc-b33a-570436c53af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e181f3-5ec4-4533-9c00-5b3ef8d29259", "name": "network-vif-deleted", "tag": "b5028992-a9ce-4b33-922b-3ec5afd6402f"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:52:50.198517 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-0c9fc8b4-b6b2-4c5b-a36a-e5678dfc4af4 req-fb641319-dac4-4fdc-b33a-570436c53af2 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:50.198992 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-0c9fc8b4-b6b2-4c5b-a36a-e5678dfc4af4 req-fb641319-dac4-4fdc-b33a-570436c53af2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:50.199416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-0c9fc8b4-b6b2-4c5b-a36a-e5678dfc4af4 req-fb641319-dac4-4fdc-b33a-570436c53af2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:50.223971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-0c9fc8b4-b6b2-4c5b-a36a-e5678dfc4af4 req-fb641319-dac4-4fdc-b33a-570436c53af2 service nova] Creating event network-vif-deleted:b5028992-a9ce-4b33-922b-3ec5afd6402f for instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 on hv-cinder-85426 Aug 24 05:52:50.242311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-0c9fc8b4-b6b2-4c5b-a36a-e5678dfc4af4 req-fb641319-dac4-4fdc-b33a-570436c53af2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060188 Aug 24 05:52:50.242918 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 501/954] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:52:50.339060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:50.348006 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0b64c0ba-fa12-4ede-9dfc-7de57d82c8b8 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.200534 Aug 24 05:52:50.348583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 454/955] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:50 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:50.660550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:50.661840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:50.669015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:50.669791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:50.670565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:50.671275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:50.671728 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:50.672146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:50.751183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:50.761086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-abc5d885-4806-468d-be81-7b0eeaad2f40 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.108397 Aug 24 05:52:50.762396 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 502/956] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:50 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:51.126491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:51.127123 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:51.140366 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:51.140865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:51.141970 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:51.142777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:51.143237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:51.143796 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:51.303153 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:51.312342 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:51.314444 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:51.315648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-30a13333-cffb-49c0-b194-84c146117dc8 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.193805 Aug 24 05:52:51.323508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 455/957] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:51 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:51.372026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:51.372680 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:51.379664 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:51.380151 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:51.380589 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:51.381291 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:51.381783 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:51.382203 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:51.523932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:51.533655 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cf431f24-1457-4712-bf29-75602eeb76e6 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.165483 Aug 24 05:52:51.534483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 503/958] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:51 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:51.784049 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:51.784589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:51.790929 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:51.791417 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:51.791853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:51.792558 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:51.793010 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:51.793436 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:51.859736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:51.868048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7d1056ce-ae77-4633-8cd6-56f2d696acae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.088540 Aug 24 05:52:51.869004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 456/959] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:51 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:52.339259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:52.339867 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:52.346307 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:52.346795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:52.347233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:52.347934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:52.348392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:52.348823 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:52.492688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:52.501455 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:52.503381 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:52.504539 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2b159dd0-0a3c-41b8-bf31-8e3d988db999 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.169316 Aug 24 05:52:52.505093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 504/960] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:52 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:52.555950 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:52.557521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:52.565885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:52.566762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:52.567598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:52.568686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:52.569360 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:52.570038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:52.710850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:52.719870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-57908744-ee8b-4657-bb6c-c73c2ed2d5ff tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.167380 Aug 24 05:52:52.734302 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 457/961] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:52 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:52.890171 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:52.890784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:52.896660 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:52.897151 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:52.897612 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:52.898305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:52.898760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:52.899184 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:52.964237 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:52.973629 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-17482425-c1bc-45c2-adb7-fb53d87992a4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.087152 Aug 24 05:52:52.981607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 505/962] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:52 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:53.529157 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:53.530653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:53.538134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:53.538647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:53.539061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:53.539788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:53.540264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:53.540661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:53.680425 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:53.689289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:53.690836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:53.691993 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ed1249e9-498c-4176-8e5f-614d4532a62f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.168409 Aug 24 05:52:53.692556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 458/963] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:53 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:53.746372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:53.747231 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:53.756318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:53.757768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:53.757768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:53.758779 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:53.759300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:53.759731 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:53.899715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:53.907774 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-62aec8f0-8c16-4531-9675-1b6e879efee4 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.167079 Aug 24 05:52:53.908343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 506/964] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:53 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:53.997047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:53.998240 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:54.005717 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:54.006555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:54.007060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:54.007868 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:54.008442 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:54.008935 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:54.076346 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:54.087094 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7f788f4f-8b5e-4c89-86a9-22f2841b5c16 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.093870 Aug 24 05:52:54.101433 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 459/965] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:53 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:54.715492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:54.716108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:54.722220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:54.722701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:54.723158 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:54.723827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:54.724281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:54.724706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:54.869390 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:54.892852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:54.895245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:54.896625 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d75b07d4-5106-44d2-8192-f3355de2c336 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.185101 Aug 24 05:52:54.897383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 507/966] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:54 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:54.928669 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:54.929289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:54.931894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:54.937257 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:54.938410 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:54.938852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:54.939549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:54.940033 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:54.940468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:55.076613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:55.085104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-37060f27-cf5b-4a4d-b0cb-54fb742f8f90 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.160271 Aug 24 05:52:55.085893 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 460/967] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:54 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:55.114146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:55.115114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:55.121085 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:55.121575 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:55.122022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:55.122704 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:55.123152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:55.123568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:55.184914 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:55.188580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:55.194524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d758ef0a-6272-43cf-8496-4720ac968447 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.084788 Aug 24 05:52:55.195466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 508/968] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:55 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:55.920798 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:55.921419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:55.928797 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:55.929436 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:55.929746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:55.930641 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:55.931257 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:55.931994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.067897 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:56.076418 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:56.077956 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:56.079184 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b63fc0ef-fff2-466e-8c2d-e8f326717ac5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.162921 Aug 24 05:52:56.079746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 461/969] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:55 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:56.106747 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:56.107523 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:56.115705 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.116212 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.116670 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.117354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.117834 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.118248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.216045 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:56.216653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:56.223966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.224449 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.224882 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.225617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:56.226060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:56.226480 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:56.256113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:56.280304 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-889d4ae6-d5a0-4c94-ac3a-fdf78f9c5a4c tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.178098 Aug 24 05:52:56.289770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 509/970] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:56 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:56.305193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:56.313875 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f37154ea-e063-41d8-b80a-7e00f3026b97 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.101595 Aug 24 05:52:56.314465 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 462/971] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:56 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:52:57.102958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:57.103486 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:57.105306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:57.112621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.113226 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.113524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:57.114258 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.114745 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.115172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:57.263550 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:57.275325 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:57.276886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:57.278280 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fa80cc63-2724-459b-815f-3043c8bf471b tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.179493 Aug 24 05:52:57.278902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 510/972] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:57 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:57.317154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:57.317965 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:57.325125 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.325864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.326562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:57.327597 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.328255 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.328954 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:57.336003 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:57.336744 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:57.342987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.343580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.344696 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:57.345495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:57.346081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:57.346774 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:57.413586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:57.424552 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-735f156f-1703-4f3a-ace0-e709f8c4f9df tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.092005 Aug 24 05:52:57.425769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 511/973] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:57 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:52:57.480968 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:57.490097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5c14d206-000e-4ee3-90fb-6e83f2afe661 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.176887 Aug 24 05:52:57.491005 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 463/974] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:57 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:58.303536 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:58.304192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:58.310532 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:58.310997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:58.311425 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:58.312118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:58.313064 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:58.313476 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:58.446370 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:58.447244 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:58.453984 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:58.454634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:58.456041 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:58.456903 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:58.457469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:58.458036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:58.458844 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:58.483649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:58.484964 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:52:58.486228 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:58.487712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d4182031-82c2-47b3-bf1f-3f80be32f114 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.188028 Aug 24 05:52:58.488858 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 512/975] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:58 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:58.511178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:58.511785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:58.517810 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:58.518288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:58.518712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:58.519394 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:58.519838 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:58.520260 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:58.541674 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:58.550365 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4eb3ed48-8c7d-4b24-9f77-c5272c51d4b1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.108068 Aug 24 05:52:58.550947 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 464/976] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:58 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:52:58.661761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:58.669397 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f130be4f-62b2-498c-951d-352f0fd9d036 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.162075 Aug 24 05:52:58.670020 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 513/977] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:58 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:59.513150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:59.513862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:59.521024 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.521505 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.521973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.522738 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.523265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.523690 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.572710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:59.574421 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:59.587581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.589019 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.590724 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.592402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.592887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.593302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.675809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:59.684244 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8f9a711b-9d59-441f-a105-bb87b7c215c6 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1612 microversion: 2.1 time: 0.115805 Aug 24 05:52:59.686617 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 514/978] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:59 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1612 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:52:59.692500 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:52:59.693130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:52:59.693261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:59.699586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.700079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.700517 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.701220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:52:59.701706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:52:59.702133 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:52:59.704022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:59.705628 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:59.706833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8725773b-5437-48ef-995f-ea13f9abc978 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.198062 Aug 24 05:52:59.707855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 465/979] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:52:59 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:52:59.838414 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:52:59.846228 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f6f4c491-3e9b-46c0-9d89-2d76b17d9a3f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.157490 Aug 24 05:52:59.846828 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 515/980] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:52:59 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:00.466658 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:00.467071 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:00.473837 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.474319 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.475046 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.475442 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.475895 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.476313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.500364 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-dd8630b2-7219-4c9c-bd66-c198c817ec7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/ips" status: 200 len: 144 microversion: 2.1 time: 0.037442 Aug 24 05:53:00.500949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 466/981] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:53:00 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:00.710172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:00.710784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:00.717147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.717596 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.718017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.718694 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.719734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.720157 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.729654 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:00.730269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:00.736973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.737456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.738015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.738720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.739175 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.739608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.751900 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.752374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.752841 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.753333 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lazy-loading 'fault' on Instance uuid b4e181f3-5ec4-4533-9c00-5b3ef8d29259 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:00.798685 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:00.806481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ca5f738d-4b5c-46bb-8b6e-d364e40ce0f4 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1329 microversion: 2.1 time: 0.100080 Aug 24 05:53:00.819926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 516/982] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:00 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:00.867862 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:00.868472 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:00.871463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:00.874250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.874721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.875684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.876376 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:00.876818 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:00.877232 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:00.881036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:00.882537 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:00.883710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-55950977-b397-4a4c-b879-cf5a59781717 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.157991 Aug 24 05:53:00.884276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 467/983] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:00 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:53:01.005593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:01.013508 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-76358905-3404-4778-9236-cbc945f10e77 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.149422 Aug 24 05:53:01.014115 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 517/984] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:00 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:01.827943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:01.828610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:01.835696 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.836174 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.836603 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.837291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.837764 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.838178 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.873544 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.874065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.874496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.874945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lazy-loading 'fault' on Instance uuid b4e181f3-5ec4-4533-9c00-5b3ef8d29259 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:53:01.906916 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:01.907533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:01.914370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.914559 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.914995 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.915691 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:01.916147 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:01.916555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b7cb87296a4ecea0b9ab44a0cbfd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfc5e65dc1412ab199fff503acbfc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:01.916679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:01.924344 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8a25c1da-7947-45b4-8518-4190fc10e0fc tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 200 len: 1329 microversion: 2.1 time: 0.100276 Aug 24 05:53:01.924915 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 468/985] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:01 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:02.035655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:02.036270 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:02.042167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.042803 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.043073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.043772 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.044228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.044647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.045538 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:02.054065 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:02.055497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:02.056686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-96d595e1-7a21-450f-8862-a1653242bdf2 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.153726 Aug 24 05:53:02.057252 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 518/986] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:01 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:53:02.177864 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:02.185768 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-53f659b4-95d7-41b4-b1ac-73d9738cc0dc tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.153918 Aug 24 05:53:02.186351 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 469/987] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:02 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:02.910956 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d08ac8c8-1610-4dd4-a868-6fe653ff159f"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:02.913357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:02.919727 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.920206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.920638 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.921316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.921848 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.922218 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.945877 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:02.946490 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:02.955054 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.955755 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.956247 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.957047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:02.957534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:02.957990 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:02.972983 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 HTTP/1.1 Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:02.974639 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:02.976276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': 'b4e181f3-5ec4-4533-9c00-5b3ef8d29259'} Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:02.977221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:02.978730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:02.980108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:02.980108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-0431e7ce-dad6-485a-b505-4b4717b8e537 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 404 len: 111 microversion: 2.1 time: 0.034111 Aug 24 05:53:02.980108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 470/988] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:02 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:53:02.985016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3d9b4811-9200-483d-b2bd-e099f5241e52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '.version_select at 0x7fa91cbf44c0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:03.004781 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3d9b4811-9200-483d-b2bd-e099f5241e52 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66780559" status: 202 len: 0 microversion: 2.1 time: 0.023801 Aug 24 05:53:03.005506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 471/989] 10.222.0.73 () {58 vars in 1215 bytes} [Wed Aug 24 05:53:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66780559 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:53:03.079969 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:03.080682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:03.088486 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.089067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.089616 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.090566 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.091268 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.092021 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.226385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c91d758c-a704-4702-9a63-fd14f1e356bd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319694 Aug 24 05:53:03.227131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 519/990] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:53:02 2022] POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:03.232434 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:03.234807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:03.242623 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.243319 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.243752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.244639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:03.245187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:03.245813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:03.305698 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:03.315711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:03.317523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:03.318942 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d6bdf639-c0bf-4451-a0e8-3b3c0b4a767f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.243498 Aug 24 05:53:03.319989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 472/991] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:03 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:53:03.399316 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:03.407584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a71ba59c-20ed-4ac8-aaa7-c1a953438a35 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.179127 Aug 24 05:53:03.408154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 520/992] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:03 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:04.343424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:04.344368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:04.351549 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.352139 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.352666 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.353459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.354026 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.354553 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.401448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-aba1af00-f026-45cf-aeba-5050cd00969d req-fdf940c4-f893-43e6-a398-731f6a08ec63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6fa69-6942-458d-b3a8-7eb647fa331f", "name": "network-vif-plugged", "status": "completed", "tag": "3088fe36-419f-41a4-bcd1-c2ce02a2cd29"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:04.412658 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-aba1af00-f026-45cf-aeba-5050cd00969d req-fdf940c4-f893-43e6-a398-731f6a08ec63 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.413133 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-aba1af00-f026-45cf-aeba-5050cd00969d req-fdf940c4-f893-43e6-a398-731f6a08ec63 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.413549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-aba1af00-f026-45cf-aeba-5050cd00969d req-fdf940c4-f893-43e6-a398-731f6a08ec63 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.431194 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-aba1af00-f026-45cf-aeba-5050cd00969d req-fdf940c4-f893-43e6-a398-731f6a08ec63 service nova] Creating event network-vif-plugged:3088fe36-419f-41a4-bcd1-c2ce02a2cd29 for instance 31a6fa69-6942-458d-b3a8-7eb647fa331f on hv-cinder-85426 Aug 24 05:53:04.436570 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-aba1af00-f026-45cf-aeba-5050cd00969d req-fdf940c4-f893-43e6-a398-731f6a08ec63 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040380 Aug 24 05:53:04.438819 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 521/993] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:53:04.444445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:04.445343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:04.452290 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.452776 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.453207 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.454121 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.454605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.455227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.511912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:04.521972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:04.523622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:04.525419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-85b62ae9-0326-4666-a254-e63cfd608afc tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.186988 Aug 24 05:53:04.526185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 473/994] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:04 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:04.607488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:04.617213 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5141472b-55e5-4e01-b20c-bd5f1aa6209f tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.176867 Aug 24 05:53:04.617827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 522/995] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:04 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:04.870132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:04.870901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:04.877229 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.877759 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.878197 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.878905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.879354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.879779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.893475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 HTTP/1.1 Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:04.895096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.896679 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': 'b4e181f3-5ec4-4533-9c00-5b3ef8d29259'} Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:04.897644 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.899055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.900508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:04.900508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7ba24058-649d-41d4-a9e6-5ea2dff59dfb tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 404 len: 111 microversion: 2.1 time: 0.030312 Aug 24 05:53:04.900508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 474/996] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:04 2022] DELETE /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:04.905143 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:04.905782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: b4e181f3-5ec4-4533-9c00-5b3ef8d29259] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:04.912193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.912671 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.913132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.913826 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:04.914275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:04.914689 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:04.928932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 HTTP/1.1 Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:04.930598 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.932099 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': 'b4e181f3-5ec4-4533-9c00-5b3ef8d29259'} Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:04.935856 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. Aug 24 05:53:04.937190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:04.938461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance b4e181f3-5ec4-4533-9c00-5b3ef8d29259 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:04.938461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-21f6e442-8a13-4d2e-b382-d57819c6beae tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259" status: 404 len: 111 microversion: 2.1 time: 0.030854 Aug 24 05:53:04.938461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 523/997] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:04 2022] GET /compute/v2.1/servers/b4e181f3-5ec4-4533-9c00-5b3ef8d29259 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:05.550199 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:05.550737 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:05.557172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.557703 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.558134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:05.558833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.559273 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.559689 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:05.639114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:05.639755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:05.645716 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.646193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.646622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:05.647309 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:05.647756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:05.648170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:05.690768 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:05.699674 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:05.701215 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:05.702594 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ee8afb45-186c-477d-babc-7b5432673c80 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1730 microversion: 2.20 time: 0.157173 Aug 24 05:53:05.703280 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 475/998] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:05 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:05.784839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:05.792465 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-486c7cec-3bdf-4d0d-978b-93ad309372f1 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.157230 Aug 24 05:53:05.793028 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 524/999] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:05 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:06.076381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.076959 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.084869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.085401 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.085995 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.086703 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.087242 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.087678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.103739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 HTTP/1.1 Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:06.105509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.107058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '3a2e0976-7c32-4f6c-a456-66c19a291d92'} Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:06.107850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.109313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.110527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:06.110527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-89ea2007-edc3-4520-83f4-d71b51fe0f89 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 404 len: 111 microversion: 2.1 time: 0.034946 Aug 24 05:53:06.110527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 476/1000] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:06 2022] DELETE /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:06.115927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.118163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 3a2e0976-7c32-4f6c-a456-66c19a291d92] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.126018 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.126573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.127079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.127934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.128802 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.129406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.134609 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:06.147235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 HTTP/1.1 Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:06.148898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.150196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '3a2e0976-7c32-4f6c-a456-66c19a291d92'} Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:06.151106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. Aug 24 05:53:06.152565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.154192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 3a2e0976-7c32-4f6c-a456-66c19a291d92 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:06.154192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-66247ed9-157b-4ab4-87ac-88b1313ffe6b tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92" status: 404 len: 111 microversion: 2.1 time: 0.038272 Aug 24 05:53:06.154192 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 525/1001] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:06 2022] GET /compute/v2.1/servers/3a2e0976-7c32-4f6c-a456-66c19a291d92 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:06.159847 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.160357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.167022 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.167609 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.167958 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.168845 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.169307 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.169967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.185507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 HTTP/1.1 Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:06.187565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.189061 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '2bfde071-16a2-4288-aec1-6d38bb343db6'} Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:06.189936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.191389 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.194155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:06.195550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2c643473-92ca-4d03-a889-6603b98f23c1 tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 404 len: 111 microversion: 2.1 time: 0.039804 Aug 24 05:53:06.200248 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 477/1002] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:06 2022] DELETE /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:06.206189 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.206932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 2bfde071-16a2-4288-aec1-6d38bb343db6] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.213541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.214531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.214718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.215641 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.216422 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.216422 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.231923 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 HTTP/1.1 Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:06.233859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.235433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '2bfde071-16a2-4288-aec1-6d38bb343db6'} Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:06.236161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. Aug 24 05:53:06.237377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:06.238450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 2bfde071-16a2-4288-aec1-6d38bb343db6 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:06.238450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4dfa75f1-7ce6-476a-88f9-19d22e92856f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6" status: 404 len: 111 microversion: 2.1 time: 0.034694 Aug 24 05:53:06.238450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 526/1003] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:06 2022] GET /compute/v2.1/servers/2bfde071-16a2-4288-aec1-6d38bb343db6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:06.461117 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-8a9c63ae-2de0-427d-bfaf-b9d88cb49032 req-8cc4c815-c4f7-444e-b857-acf6ef8c281e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "977405bb-cdcc-4b20-b7ae-754ab660c7c3", "name": "network-vif-plugged", "status": "completed", "tag": "477bcaf5-dea4-412c-a5c0-a5d8080b11f0"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:06.471633 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8a9c63ae-2de0-427d-bfaf-b9d88cb49032 req-8cc4c815-c4f7-444e-b857-acf6ef8c281e service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.472124 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8a9c63ae-2de0-427d-bfaf-b9d88cb49032 req-8cc4c815-c4f7-444e-b857-acf6ef8c281e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.472555 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8a9c63ae-2de0-427d-bfaf-b9d88cb49032 req-8cc4c815-c4f7-444e-b857-acf6ef8c281e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.485833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-8a9c63ae-2de0-427d-bfaf-b9d88cb49032 req-8cc4c815-c4f7-444e-b857-acf6ef8c281e service nova] Creating event network-vif-plugged:477bcaf5-dea4-412c-a5c0-a5d8080b11f0 for instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 on hv-cinder-85426 Aug 24 05:53:06.491193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-8a9c63ae-2de0-427d-bfaf-b9d88cb49032 req-8cc4c815-c4f7-444e-b857-acf6ef8c281e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033632 Aug 24 05:53:06.491966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 478/1004] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:06.726066 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.726688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.733668 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.734275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.734722 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.735419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.735873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.736297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.814533 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:06.815485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:06.822105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.822687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.823195 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.823971 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:06.824686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:06.825446 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:06.874706 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:06.883387 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:06.884890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:06.886079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dc3a753f-58d4-4a26-abbf-1610f954352a tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1717 microversion: 2.20 time: 0.164235 Aug 24 05:53:06.886642 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 527/1005] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:06 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:06.968557 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:06.976962 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f9b913b7-fb32-4e36-96e3-f08ca659b207 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1576 microversion: 2.1 time: 0.167475 Aug 24 05:53:06.977457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 479/1006] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:06 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:07.396209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.396719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:07.403040 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.403518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.403953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.404636 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.405085 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.405508 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.418417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: DELETE /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 HTTP/1.1 Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:07.419984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.421317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '0914a19f-ad14-4b39-84b5-dc7296adcf95'} Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:07.422719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.424108 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.425699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:07.425699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-09172dd1-866b-4ae2-a5eb-74979b32475f tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "DELETE /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 404 len: 111 microversion: 2.1 time: 0.028954 Aug 24 05:53:07.425699 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 528/1007] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:53:07 2022] DELETE /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:07.430223 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.430848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] [instance: 0914a19f-ad14-4b39-84b5-dc7296adcf95] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:07.436748 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.437253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.438440 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.439006 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:07.439456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:07.439882 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:07.452965 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] HTTP exception thrown: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Request method failure captured: Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 HTTP/1.1 Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsbw0k-HEYaSb7ReTbvLhFmLQSRxj8ScTxcI5zRmLK99GB5mkeipwTADMeud8--fLQNsHJdSio5Mn8Lz7awKlRaa50WZ_aBR6ggGPFaecoGmVilrOuYLZuKBsgdOsGvOCSKUieKoY5qHnXX1DQhSLnzjIK5S07_0sN3C_EqEhxq1tg Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:07.454657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/57dfc5e65dc1412ab199fff503acbfc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 57dfc5e65dc1412ab199fff503acbfc3 Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-585438446 Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: c8b7cb87296a4ecea0b9ab44a0cbfd2c Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeNegativeTest-585438446-project Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.456295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '0914a19f-ad14-4b39-84b5-dc7296adcf95'} Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:07.457217 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. Aug 24 05:53:07.458653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:07.459999 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] Returning 404 to user: Instance 0914a19f-ad14-4b39-84b5-dc7296adcf95 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:07.459999 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-131972d9-0e5a-408f-a39f-1251feb8246d tempest-AttachVolumeNegativeTest-585438446 tempest-AttachVolumeNegativeTest-585438446-project] 10.222.0.73 "GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95" status: 404 len: 111 microversion: 2.1 time: 0.029706 Aug 24 05:53:07.459999 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 480/1008] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:07 2022] GET /compute/v2.1/servers/0914a19f-ad14-4b39-84b5-dc7296adcf95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:07.998024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:07.998621 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:08.005371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:08.005929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:08.006378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:08.007078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:08.007533 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:08.008009 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:08.144430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:08.152304 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-4d0f6d49-5ad9-4def-8c4f-8a1830cfcd43 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1563 microversion: 2.1 time: 0.158158 Aug 24 05:53:08.152869 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 529/1009] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:07 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:10.798379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-525994f1-ed8d-47cc-b717-dba79474254a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:10.814543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-525994f1-ed8d-47cc-b717-dba79474254a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.814945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-525994f1-ed8d-47cc-b717-dba79474254a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.815427 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-525994f1-ed8d-47cc-b717-dba79474254a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.886534 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-525994f1-ed8d-47cc-b717-dba79474254a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Going to try to stop instance {{(pid=127193) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 05:53:10.947526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-525994f1-ed8d-47cc-b717-dba79474254a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action" status: 202 len: 0 microversion: 2.1 time: 0.152430 Aug 24 05:53:10.949135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 481/1010] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:53:10 2022] POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:53:10.957503 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:10.958639 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:10.964597 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.965083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.965526 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:10.966249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:10.966930 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:10.967287 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:11.100617 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:11.110649 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6d6670fc-63c2-4149-8e74-4af5bc6739c6 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.157242 Aug 24 05:53:11.111300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 530/1011] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:10 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:11.935140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9c64ef8e-60f3-42db-bb04-71024fcddb05 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Action: 'create', calling method: .version_select at 0x7fa91c269f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-438410095", "metadata": {"Type": "work"}}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9c64ef8e-60f3-42db-bb04-71024fcddb05 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Request method failure captured: Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 121 Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbzHWoTqKBlqfjv16catkzklWTYvLsVevqgK4NRDKjAO7NRv1ThtCyDhC9L8ZiwtOBXL-syaQVqqn4XJECLj2jmpiPIGK1KBsS9jP0RAh6zW3_1i3wKDELQ3Y3LmrdswM4XfOIHFEuQzJcI3hhQnzLavA6u3gR41IkAS03WgQI3qC7Y Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:11.951688 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: e5217041950a48f78f40259782a298d3 Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-438410095", "metadata": {"Type": "work"}}} Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: Aug 24 05:53:11.953279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-438410095', 'metadata': {'Type': 'work'}}}} Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:11.955172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:53:11.956667 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:53:11.958222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 05:53:11.958222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.958222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9c64ef8e-60f3-42db-bb04-71024fcddb05 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:11.958222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9c64ef8e-60f3-42db-bb04-71024fcddb05 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128639 Aug 24 05:53:11.958222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 482/1012] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 05:53:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:53:11.962725 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e73badcc-8541-4ebe-8e0f-5bad89eff621 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Action: 'create', calling method: .version_select at 0x7fa91c3dc310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-650344419", "metadata": {"Type": "work"}}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e73badcc-8541-4ebe-8e0f-5bad89eff621 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Request method failure captured: Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 119 Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbzHWoTqKBlqfjv16catkzklWTYvLsVevqgK4NRDKjAO7NRv1ThtCyDhC9L8ZiwtOBXL-syaQVqqn4XJECLj2jmpiPIGK1KBsS9jP0RAh6zW3_1i3wKDELQ3Y3LmrdswM4XfOIHFEuQzJcI3hhQnzLavA6u3gR41IkAS03WgQI3qC7Y Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:11.967266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: e5217041950a48f78f40259782a298d3 Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-650344419", "metadata": {"Type": "work"}}} Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: Aug 24 05:53:11.968953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-650344419', 'metadata': {'Type': 'work'}}}} Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi '0' Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:11.969927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:53:11.971640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:53:11.973173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 05:53:11.973173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.973173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e73badcc-8541-4ebe-8e0f-5bad89eff621 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:11.973173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e73badcc-8541-4ebe-8e0f-5bad89eff621 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009849 Aug 24 05:53:11.973173 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 531/1013] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 05:53:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:53:11.979740 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f10de98e-3aa2-4100-b86d-30df54b4f203 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Action: 'create', calling method: .version_select at 0x7fa91cc36160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1796314102", "metadata": {"Type": "work"}}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f10de98e-3aa2-4100-b86d-30df54b4f203 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Request method failure captured: Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 119 Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbzHWoTqKBlqfjv16catkzklWTYvLsVevqgK4NRDKjAO7NRv1ThtCyDhC9L8ZiwtOBXL-syaQVqqn4XJECLj2jmpiPIGK1KBsS9jP0RAh6zW3_1i3wKDELQ3Y3LmrdswM4XfOIHFEuQzJcI3hhQnzLavA6u3gR41IkAS03WgQI3qC7Y Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:11.982905 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: e5217041950a48f78f40259782a298d3 Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1796314102", "metadata": {"Type": "work"}}} Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: Aug 24 05:53:11.985136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1796314102', 'metadata': {'Type': 'work'}}}} Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise error Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi '' Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:11.986015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 05:53:11.987645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 05:53:11.989096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 05:53:11.989096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:11.989096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f10de98e-3aa2-4100-b86d-30df54b4f203 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:11.989096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f10de98e-3aa2-4100-b86d-30df54b4f203 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010331 Aug 24 05:53:11.989096 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 483/1014] 10.222.0.73 () {60 vars in 1156 bytes} [Wed Aug 24 05:53:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:53:11.996001 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a95411a4-4f42-4526-a3a9-b6fcfbcf0e08 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Calling method '.version_select at 0x7fa91c3b0940>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:12.024886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-a95411a4-4f42-4526-a3a9-b6fcfbcf0e08 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] HTTP exception thrown: Volume tempest-invalid-1918495473 could not be found. Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a95411a4-4f42-4526-a3a9-b6fcfbcf0e08 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Request method failure captured: Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1918495473 HTTP/1.1 Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbzHWoTqKBlqfjv16catkzklWTYvLsVevqgK4NRDKjAO7NRv1ThtCyDhC9L8ZiwtOBXL-syaQVqqn4XJECLj2jmpiPIGK1KBsS9jP0RAh6zW3_1i3wKDELQ3Y3LmrdswM4XfOIHFEuQzJcI3hhQnzLavA6u3gR41IkAS03WgQI3qC7Y Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:12.028034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: e5217041950a48f78f40259782a298d3 Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Volume tempest-invalid-1918495473 could not be found. Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': 'tempest-invalid-1918495473'} Aug 24 05:53:12.029447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1918495473 could not be found. (HTTP 404) (Request-ID: req-dc09367e-132b-4eea-9c4e-5f83cacf3775) Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.030306 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:53:12.031785 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1918495473 could not be found. Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:12.033318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1918495473 could not be found. Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1918495473 could not be found. Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a95411a4-4f42-4526-a3a9-b6fcfbcf0e08 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Returning 404 to user: Volume tempest-invalid-1918495473 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a95411a4-4f42-4526-a3a9-b6fcfbcf0e08 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1918495473" status: 404 len: 99 microversion: 2.1 time: 0.037750 Aug 24 05:53:12.034868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 532/1015] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 05:53:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1918495473 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:53:12.039030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8f230f16-b606-49f1-bfbd-2a14e67be5a4 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003747 Aug 24 05:53:12.039516 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 484/1016] 10.222.0.73 () {58 vars in 1140 bytes} [Wed Aug 24 05:53:12 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 05:53:12.048222 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a7dfd3a0-cbd5-427f-a48b-1d1c67729ad4 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004257 Aug 24 05:53:12.048713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 533/1017] 10.222.0.73 () {58 vars in 1137 bytes} [Wed Aug 24 05:53:12 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 05:53:12.056846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7885e589-0aa9-4d7d-88d2-cb4879b7bd33 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Calling method '.version_select at 0x7fa91cda7a60>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:12.084554 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-7885e589-0aa9-4d7d-88d2-cb4879b7bd33 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] HTTP exception thrown: Volume 8d47fbc2-d769-4d35-b464-4520926676f0 could not be found. Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7885e589-0aa9-4d7d-88d2-cb4879b7bd33 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Request method failure captured: Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/os-volumes/8d47fbc2-d769-4d35-b464-4520926676f0 HTTP/1.1 Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbzHWoTqKBlqfjv16catkzklWTYvLsVevqgK4NRDKjAO7NRv1ThtCyDhC9L8ZiwtOBXL-syaQVqqn4XJECLj2jmpiPIGK1KBsS9jP0RAh6zW3_1i3wKDELQ3Y3LmrdswM4XfOIHFEuQzJcI3hhQnzLavA6u3gR41IkAS03WgQI3qC7Y Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:12.086527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: e5217041950a48f78f40259782a298d3 Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Volume 8d47fbc2-d769-4d35-b464-4520926676f0 could not be found. Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '8d47fbc2-d769-4d35-b464-4520926676f0'} Aug 24 05:53:12.088042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d47fbc2-d769-4d35-b464-4520926676f0 could not be found. (HTTP 404) (Request-ID: req-e3792bab-2306-4a7c-a847-aa177b67b0ba) Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.089106 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:53:12.090613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d47fbc2-d769-4d35-b464-4520926676f0 could not be found. Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:53:12.093155 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d47fbc2-d769-4d35-b464-4520926676f0 could not be found. Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d47fbc2-d769-4d35-b464-4520926676f0 could not be found. Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7885e589-0aa9-4d7d-88d2-cb4879b7bd33 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Returning 404 to user: Volume 8d47fbc2-d769-4d35-b464-4520926676f0 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7885e589-0aa9-4d7d-88d2-cb4879b7bd33 tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/8d47fbc2-d769-4d35-b464-4520926676f0" status: 404 len: 109 microversion: 2.1 time: 0.034614 Aug 24 05:53:12.095176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 485/1018] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:53:12 2022] DELETE /compute/v2.1/os-volumes/8d47fbc2-d769-4d35-b464-4520926676f0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:53:12.097418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dcc7a774-3a65-4601-aa91-f5b7b2959c2e tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Calling method '.version_select at 0x7fa91c433a60>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:12.124607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-dcc7a774-3a65-4601-aa91-f5b7b2959c2e tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] HTTP exception thrown: Volume 45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 could not be found. Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dcc7a774-3a65-4601-aa91-f5b7b2959c2e tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Request method failure captured: Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/os-volumes/45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 HTTP/1.1 Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbzHWoTqKBlqfjv16catkzklWTYvLsVevqgK4NRDKjAO7NRv1ThtCyDhC9L8ZiwtOBXL-syaQVqqn4XJECLj2jmpiPIGK1KBsS9jP0RAh6zW3_1i3wKDELQ3Y3LmrdswM4XfOIHFEuQzJcI3hhQnzLavA6u3gR41IkAS03WgQI3qC7Y Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:12.127199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/58962a2f968c4e28909cab3a1856e1b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 58962a2f968c4e28909cab3a1856e1b6 Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesNegativeTest-654726376 Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: e5217041950a48f78f40259782a298d3 Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesNegativeTest-654726376-project Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Volume 45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 could not be found. Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1'} Aug 24 05:53:12.128604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 could not be found. (HTTP 404) (Request-ID: req-4695b9c5-d638-4767-b285-f473b6a1b9bb) Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.129791 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:53:12.131162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 could not be found. Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:53:12.132510 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 could not be found. Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 could not be found. Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dcc7a774-3a65-4601-aa91-f5b7b2959c2e tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] Returning 404 to user: Volume 45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dcc7a774-3a65-4601-aa91-f5b7b2959c2e tempest-VolumesNegativeTest-654726376 tempest-VolumesNegativeTest-654726376-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1" status: 404 len: 109 microversion: 2.1 time: 0.034954 Aug 24 05:53:12.133903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 534/1019] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:53:12 2022] GET /compute/v2.1/os-volumes/45c6fd66-e1e8-4c2e-a4e3-f4013ba83de1 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:53:12.141331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:12.142162 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:12.148476 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.149039 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.149552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.150390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:12.150935 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:12.151372 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:12.291617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:12.300776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-45b5ae97-c938-4dd0-b2f1-75b55ec3a8d1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.172523 Aug 24 05:53:12.301352 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 486/1020] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:12 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:53:13.321812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:13.322422 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:13.329358 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.329909 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.330345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.331034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:13.331487 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:13.331908 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:13.470389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:13.478695 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3dee96e4-f1fb-4390-a653-c9107db57576 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.161372 Aug 24 05:53:13.479424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 535/1021] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:13 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:14.500163 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:14.500785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:14.507286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.507771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.508211 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.508910 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:14.509369 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:14.509818 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:14.642608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:14.650794 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-89158e65-2a70-45c6-b1f1-b66bb654e1e2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.154569 Aug 24 05:53:14.651671 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 487/1022] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:14 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:15.672993 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:15.673633 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:15.679804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:15.680309 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:15.680734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:15.681417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:15.681901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:15.682320 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:15.905597 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:15.914793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-342657e0-2ae5-487e-af6b-6a1705db9c83 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.246042 Aug 24 05:53:15.915355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 536/1023] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:15 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:16.935912 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:16.936529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:16.943973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.944460 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.944896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:16.945610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:16.946074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:16.946498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:17.081879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:17.090347 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bfbc8366-a1d9-4201-ab51-30a358746938 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.158134 Aug 24 05:53:17.090926 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 488/1024] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:16 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:18.112079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:18.112721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:18.119447 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:18.119936 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:18.120371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:18.121082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:18.121591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:18.122022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:18.272806 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:18.281541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-696bdb39-1602-4ce8-bda2-2337b249c86c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.173610 Aug 24 05:53:18.282148 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 537/1025] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:18 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:19.303074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:19.303719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:19.310169 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:19.310653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:19.311088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:19.311785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:19.312744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:19.313172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:19.317280 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:19.446193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:19.454265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ce024639-452d-4537-b191-fcb473be8e99 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.155029 Aug 24 05:53:19.454838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 489/1026] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:19 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:20.475396 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:20.475991 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:20.482430 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.482903 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.483583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.484289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:20.484734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:20.485152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:20.611750 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:20.619879 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c7367bad-be3a-4736-a110-1148a0f5713e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.148371 Aug 24 05:53:20.620443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 538/1027] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:20 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:21.641477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:21.642657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:21.648966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.649451 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.649915 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.650599 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:21.651211 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:21.651634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:21.793780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:21.801932 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-176dd9ad-31fe-437f-be59-148916d1c1a5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.164761 Aug 24 05:53:21.802501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 490/1028] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:21 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:22.824245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:22.825032 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:22.831770 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.832254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.832687 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:22.833583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:22.834041 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:22.834464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:23.005399 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:23.014296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cb49b6ae-0c76-49eb-a34b-71a9cde1eb9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.194199 Aug 24 05:53:23.014888 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 539/1029] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:22 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:24.035961 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:24.037304 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:24.043649 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.044197 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.044658 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.045340 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:24.045809 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:24.046228 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:24.178074 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:24.186279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-24c6d143-68cd-4c8d-89b3-3d9564dac5ed tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.154159 Aug 24 05:53:24.186855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 491/1030] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:24 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:25.208314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:25.208977 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:25.215781 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.216267 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.216692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.217378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:25.217855 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:25.218771 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:25.351122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:25.360249 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-387365b8-0320-47db-b90c-45b26ee90ff5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.156271 Aug 24 05:53:25.360813 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 540/1031] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:25 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:26.381896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:26.382515 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:26.384823 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:26.390092 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.390587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.391088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.391945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:26.393027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:26.393027 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:26.531053 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:26.539264 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-2659280c-344d-49e1-a3f3-56b1c30dfc2c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1721 microversion: 2.1 time: 0.161429 Aug 24 05:53:26.539836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 492/1032] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:26 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:27.560295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:27.560904 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:27.563733 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=56 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:27.569302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.569809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.570243 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.570936 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.571386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.571807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.753406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:27.762427 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9e543414-fd91-4198-8e4c-53fede5882a1 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1698 microversion: 2.1 time: 0.205881 Aug 24 05:53:27.763019 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 541/1033] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:27 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1698 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:27.784085 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-97efe63e-cd5e-44f3-8626-051e49f4b990 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:27.790538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97efe63e-cd5e-44f3-8626-051e49f4b990 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.791099 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97efe63e-cd5e-44f3-8626-051e49f4b990 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.791643 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-97efe63e-cd5e-44f3-8626-051e49f4b990 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.816019 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-97efe63e-cd5e-44f3-8626-051e49f4b990 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Going to try to start instance {{(pid=127193) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 05:53:27.860068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-97efe63e-cd5e-44f3-8626-051e49f4b990 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action" status: 202 len: 0 microversion: 2.1 time: 0.080208 Aug 24 05:53:27.860683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 493/1034] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:53:27 2022] POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:53:27.869924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:27.870543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:27.878804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.879443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.880595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:27.881305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:27.881792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:27.882402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:28.038279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:28.046687 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bb45ac70-f163-4673-81f8-e6708adf793f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1707 microversion: 2.1 time: 0.180906 Aug 24 05:53:28.047912 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 542/1035] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:27 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1707 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:29.069145 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:29.070141 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:29.076808 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.077283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.077773 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.078466 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:29.078919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:29.079333 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:29.216691 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:29.226029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-72628376-f1ce-4dfa-a696-f0a85b9ba4f7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1707 microversion: 2.1 time: 0.161629 Aug 24 05:53:29.226620 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 494/1036] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:29 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1707 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:30.247460 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:30.248071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:30.254715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:30.255202 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:30.255634 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:30.256329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:30.256778 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:30.257199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:30.395948 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:30.404088 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a49c87ff-d598-49bd-9eea-b6eac39a162f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1711 microversion: 2.1 time: 0.160456 Aug 24 05:53:30.404651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 543/1037] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:53:30 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1711 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:46.909332 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:46.911651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:46.914371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=5 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:46.915037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:46.920552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:46.921042 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:46.921480 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:46.922209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:46.922666 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:46.923577 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:46.956538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fb916e6c-48e8-43fa-967b-8409c6f7d671 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051218 Aug 24 05:53:46.957104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 495/1038] 10.222.0.73 () {60 vars in 1343 bytes} [Wed Aug 24 05:53:46 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:53:47.020863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:47.021377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:47.023835 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=5 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:47.024493 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=76 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:53:47.029994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:47.030480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:47.030944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:47.031646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:47.032100 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:47.032557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:47.057245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:53:47.131872 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-584a9907-8970-46a1-8213-5bffe55997b5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 204 len: 0 microversion: 2.20 time: 0.114590 Aug 24 05:53:47.132580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 544/1039] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 05:53:47 2022] DELETE /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:53:47.140657 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:47.141267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:47.147408 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:47.147888 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:47.148339 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:47.149015 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:47.149469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:47.149917 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:47.276967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:47.285553 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:47.287063 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:47.288210 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-33807f17-e7ff-49cc-ad87-4497eadb1ec0 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.151474 Aug 24 05:53:47.288754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 496/1040] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:47 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:53:48.311801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:48.312499 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:48.319546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:48.320026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:48.320483 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:48.321180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:48.321656 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:48.322081 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:48.509356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:48.517466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:48.519022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:48.520187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a1ecb1e3-5266-4a86-aa2c-1af826506339 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1723 microversion: 2.20 time: 0.212677 Aug 24 05:53:48.520746 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 545/1041] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:48 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:49.543779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:49.544916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:49.553355 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:49.553867 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:49.554457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:49.556035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:49.556506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:49.556940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:49.631354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:49.640682 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:49.643178 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b18352a23444324b27d17d2cee636fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47156a6d045b4147a837fbf132421a53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:53:49.644712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-173de855-52da-4b72-a283-d6bd45533094 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 200 len: 1656 microversion: 2.20 time: 0.106059 Aug 24 05:53:49.645865 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 497/1042] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:49 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:53:49.819271 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-6af457c1-dc80-4d08-9193-eff6b69f774c req-16407751-8748-428b-8cdf-28b6f1980ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31a6fa69-6942-458d-b3a8-7eb647fa331f", "name": "network-vif-deleted", "tag": "3088fe36-419f-41a4-bcd1-c2ce02a2cd29"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:53:49.833666 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-6af457c1-dc80-4d08-9193-eff6b69f774c req-16407751-8748-428b-8cdf-28b6f1980ba3 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:49.834148 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-6af457c1-dc80-4d08-9193-eff6b69f774c req-16407751-8748-428b-8cdf-28b6f1980ba3 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:49.834579 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-6af457c1-dc80-4d08-9193-eff6b69f774c req-16407751-8748-428b-8cdf-28b6f1980ba3 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:49.848682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-6af457c1-dc80-4d08-9193-eff6b69f774c req-16407751-8748-428b-8cdf-28b6f1980ba3 service nova] Creating event network-vif-deleted:3088fe36-419f-41a4-bcd1-c2ce02a2cd29 for instance 31a6fa69-6942-458d-b3a8-7eb647fa331f on hv-cinder-85426 Aug 24 05:53:49.855853 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-6af457c1-dc80-4d08-9193-eff6b69f774c req-16407751-8748-428b-8cdf-28b6f1980ba3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040091 Aug 24 05:53:49.857145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 546/1043] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:53:50.668742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:50.669749 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:50.676205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:50.676686 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:50.677119 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:50.677933 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:50.678394 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:50.678898 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:50.693154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] HTTP exception thrown: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Request method failure captured: Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f HTTP/1.1 Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsXOfKWEejOFx7fL815iUihSZUeqT0FnFfYIOoUjATZIa30KOvQxKFcvEo28Mwdhx-ci4ef-6-dxE45u6IC0B-rSrWZtq0ytnlcF8NGM09s1nSL-T3stdbzMdhpU-ftFIoWhGbAg42DJdHiNjlsh1RR0fS_RKqfRXGyfpq0oz9t2ZI Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:50.694874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_47156a6d045b4147a837fbf132421a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/47156a6d045b4147a837fbf132421a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 0b18352a23444324b27d17d2cee636fc Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:50.696563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '31a6fa69-6942-458d-b3a8-7eb647fa331f'} Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:50.697728 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:50.699253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:50.700955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Returning 404 to user: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:50.700955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-35f06aef-c38e-4b11-8533-0a3bd17110d5 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 404 len: 111 microversion: 2.20 time: 0.031538 Aug 24 05:53:50.700955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 498/1044] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:50 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:53:50.707248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-73c4cce2-684b-45f9-a732-ae25bfe80b60 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '.version_select at 0x7fa91c3b03a0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:50.727243 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-73c4cce2-684b-45f9-a732-ae25bfe80b60 tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671722112" status: 204 len: 0 microversion: 2.20 time: 0.024518 Aug 24 05:53:50.727823 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 547/1045] 10.222.0.73 () {60 vars in 1262 bytes} [Wed Aug 24 05:53:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671722112 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:53:52.534205 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:52.534901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:52.541729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:52.542293 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:52.542811 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:52.543647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:52.544150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:52.544604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:52.559530 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] HTTP exception thrown: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Request method failure captured: Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f HTTP/1.1 Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsXOfKWEejOFx7fL815iUihSZUeqT0FnFfYIOoUjATZIa30KOvQxKFcvEo28Mwdhx-ci4ef-6-dxE45u6IC0B-rSrWZtq0ytnlcF8NGM09s1nSL-T3stdbzMdhpU-ftFIoWhGbAg42DJdHiNjlsh1RR0fS_RKqfRXGyfpq0oz9t2ZI Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:52.561177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_47156a6d045b4147a837fbf132421a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/47156a6d045b4147a837fbf132421a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 0b18352a23444324b27d17d2cee636fc Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.562848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '31a6fa69-6942-458d-b3a8-7eb647fa331f'} Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:52.564262 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.565771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.567192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Returning 404 to user: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:52.567192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-98c86180-3061-42c9-b4f5-16939b1ecaaa tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 404 len: 111 microversion: 2.20 time: 0.032368 Aug 24 05:53:52.567192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 499/1046] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 05:53:52 2022] DELETE /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:53:52.573035 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:52.573806 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 31a6fa69-6942-458d-b3a8-7eb647fa331f] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:52.580871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:52.581350 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:52.581809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:52.582495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:52.582946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:52.583364 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:52.596152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] HTTP exception thrown: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Request method failure captured: Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f HTTP/1.1 Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsXOfKWEejOFx7fL815iUihSZUeqT0FnFfYIOoUjATZIa30KOvQxKFcvEo28Mwdhx-ci4ef-6-dxE45u6IC0B-rSrWZtq0ytnlcF8NGM09s1nSL-T3stdbzMdhpU-ftFIoWhGbAg42DJdHiNjlsh1RR0fS_RKqfRXGyfpq0oz9t2ZI Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:52.597929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_47156a6d045b4147a837fbf132421a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/47156a6d045b4147a837fbf132421a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 0b18352a23444324b27d17d2cee636fc Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.599653 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '31a6fa69-6942-458d-b3a8-7eb647fa331f'} Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:52.600603 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. Aug 24 05:53:52.602072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:52.603402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Returning 404 to user: Instance 31a6fa69-6942-458d-b3a8-7eb647fa331f could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:52.603402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-26ad5a3c-c172-40f3-876c-a82a32570e0f tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f" status: 404 len: 111 microversion: 2.20 time: 0.031263 Aug 24 05:53:52.603402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 548/1047] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:52 2022] GET /compute/v2.1/servers/31a6fa69-6942-458d-b3a8-7eb647fa331f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:53:53.738234 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:53.738799 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:53.745156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:53.745687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:53.746129 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:53.746838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:53.747291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:53.747716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:53.761604 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] HTTP exception thrown: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Request method failure captured: Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 HTTP/1.1 Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbsXOfKWEejOFx7fL815iUihSZUeqT0FnFfYIOoUjATZIa30KOvQxKFcvEo28Mwdhx-ci4ef-6-dxE45u6IC0B-rSrWZtq0ytnlcF8NGM09s1nSL-T3stdbzMdhpU-ftFIoWhGbAg42DJdHiNjlsh1RR0fS_RKqfRXGyfpq0oz9t2ZI Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:53:53.763289 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_47156a6d045b4147a837fbf132421a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/47156a6d045b4147a837fbf132421a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 0b18352a23444324b27d17d2cee636fc Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.764936 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '48d5dce2-87d9-41e2-87bd-e25ffdab7014'} Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:53.765816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.767778 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.771108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Returning 404 to user: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:53.771108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4b6fb0d0-055a-4e4d-ab03-eb4f976e88fd tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "DELETE /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 404 len: 111 microversion: 2.20 time: 0.030475 Aug 24 05:53:53.771108 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 500/1048] 10.222.0.73 () {60 vars in 1280 bytes} [Wed Aug 24 05:53:53 2022] DELETE /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:53:53.773740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:53:53.774354 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] [instance: 48d5dce2-87d9-41e2-87bd-e25ffdab7014] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:53:53.780824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:53.781359 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:53.781881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:53.783217 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:53:53.783669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:53:53.784095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:53:53.797372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] HTTP exception thrown: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Request method failure captured: Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 HTTP/1.1 Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbsXOfKWEejOFx7fL815iUihSZUeqT0FnFfYIOoUjATZIa30KOvQxKFcvEo28Mwdhx-ci4ef-6-dxE45u6IC0B-rSrWZtq0ytnlcF8NGM09s1nSL-T3stdbzMdhpU-ftFIoWhGbAg42DJdHiNjlsh1RR0fS_RKqfRXGyfpq0oz9t2ZI Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:53:53.799037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_47156a6d045b4147a837fbf132421a53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/47156a6d045b4147a837fbf132421a53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/47156a6d045b4147a837fbf132421a53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 47156a6d045b4147a837fbf132421a53 Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-668035063 Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 0b18352a23444324b27d17d2cee636fc Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeShelveTestJSON-668035063-project Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.803078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '48d5dce2-87d9-41e2-87bd-e25ffdab7014'} Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:53:53.803951 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. Aug 24 05:53:53.805389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:53:53.806754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] Returning 404 to user: Instance 48d5dce2-87d9-41e2-87bd-e25ffdab7014 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:53:53.806754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c54eb891-5e4d-4754-89ba-f6b243986f7d tempest-AttachVolumeShelveTestJSON-668035063 tempest-AttachVolumeShelveTestJSON-668035063-project] 10.222.0.73 "GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014" status: 404 len: 111 microversion: 2.20 time: 0.030601 Aug 24 05:53:53.806754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 549/1049] 10.222.0.73 () {60 vars in 1277 bytes} [Wed Aug 24 05:53:53 2022] GET /compute/v2.1/servers/48d5dce2-87d9-41e2-87bd-e25ffdab7014 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:54:08.648033 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:08.648536 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:08.650611 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=12 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:08.651407 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=24 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:08.669160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:08.669955 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:08.670397 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:08.671105 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:08.671589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:08.672048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:08.754624 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lazy-loading 'services' on Instance uuid 748a59dc-9754-4a71-9f3d-754a13bf75f4 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:54:08.828475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a56f129c-397c-4e12-950d-b6e47fcb5306 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-volume_attachments/d08ac8c8-1610-4dd4-a868-6fe653ff159f" status: 202 len: 0 microversion: 2.1 time: 0.184345 Aug 24 05:54:08.829064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 501/1050] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:54:08 2022] DELETE /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-volume_attachments/d08ac8c8-1610-4dd4-a868-6fe653ff159f => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:54:09.958475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c73b359a-25e1-49ba-a19b-fbff707256fa tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:09.961207 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:09.961887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:09.969235 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c73b359a-25e1-49ba-a19b-fbff707256fa tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:09.969761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c73b359a-25e1-49ba-a19b-fbff707256fa tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:09.970199 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-c73b359a-25e1-49ba-a19b-fbff707256fa tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:10.036719 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-c73b359a-25e1-49ba-a19b-fbff707256fa tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Going to try to stop instance {{(pid=127194) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 05:54:10.092531 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c73b359a-25e1-49ba-a19b-fbff707256fa tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action" status: 202 len: 0 microversion: 2.1 time: 0.138061 Aug 24 05:54:10.093146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 550/1051] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:54:09 2022] POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:54:10.103661 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:10.105000 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:10.113543 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:10.115234 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:10.115816 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:10.116712 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:10.117359 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:10.119149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:10.252881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:10.260838 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b2aaa560-894a-483b-9048-6b0327e571dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.163312 Aug 24 05:54:10.261403 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 502/1052] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:10 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:11.282155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:11.282929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:11.291458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.292116 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.292551 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:11.293307 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:11.293820 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:11.294246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:11.457622 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:11.466591 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d75ac5ec-1c97-44c6-a10b-99e4915a6ecd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.188713 Aug 24 05:54:11.467155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 551/1053] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:11 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:12.488895 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:12.489519 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:12.495891 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:12.496379 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:12.496819 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:12.497523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:12.498002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:12.498428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:12.639883 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:12.649100 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5a60e41c-3905-4696-9a17-405e311f2368 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.163984 Aug 24 05:54:12.649699 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 503/1054] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:12 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:13.670586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:13.671198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:13.677662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:13.678150 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:13.678584 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:13.679287 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:13.679741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:13.680169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:13.810865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:13.818742 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8a88926a-eb3e-47d9-ba21-a40e72384d38 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.152222 Aug 24 05:54:13.819318 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 552/1055] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:13 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:14.841121 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:14.841767 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:14.848670 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.849160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.849626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.850321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:14.850777 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:14.851204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:14.979564 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:14.988460 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ddf846a8-46d2-4928-b447-0cb72f9195ab tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.151204 Aug 24 05:54:14.989067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 504/1056] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:14 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:16.009480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:16.010129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:16.016482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:16.016960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:16.017395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:16.018114 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:16.018566 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:16.018986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:16.147155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:16.154894 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-87d70349-2469-48a7-ac12-c8103bd4f4b9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.149214 Aug 24 05:54:16.155458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 553/1057] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:16 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:17.175951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:17.176565 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:17.182974 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:17.183457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:17.183894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:17.184596 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:17.185055 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:17.185478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:17.351216 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:17.361355 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6f8421d2-6c46-47f3-b464-22799389f9a3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.189325 Aug 24 05:54:17.374190 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 505/1058] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:17 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:18.382309 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:18.383020 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:18.389286 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:18.389819 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:18.390259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:18.390961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:18.391410 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:18.392017 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:18.741122 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:18.748658 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-69547112-0b70-4d09-966a-9aa93d883c00 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.370092 Aug 24 05:54:18.749223 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 554/1059] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:18 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:19.771617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:19.772298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:19.778720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:19.779196 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:19.779626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:19.780317 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:19.780772 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:19.781185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:19.920788 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:19.929253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c447a5a6-7cb6-4746-bfe1-e04b6a7517b8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1675 microversion: 2.1 time: 0.162261 Aug 24 05:54:19.930076 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 506/1060] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:19 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:20.950526 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:20.951129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:20.957556 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:20.958069 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:20.958496 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:20.959177 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:20.959657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:20.960074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:21.103339 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:21.116640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-7d52ecb1-81de-406c-ab64-122e127bfe9d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1652 microversion: 2.1 time: 0.164816 Aug 24 05:54:21.116640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 555/1061] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:20 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1652 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:21.133062 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e3808832-37e2-48f8-bc59-d6786b716d5e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:21.139757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3808832-37e2-48f8-bc59-d6786b716d5e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:21.140310 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3808832-37e2-48f8-bc59-d6786b716d5e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:21.140826 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e3808832-37e2-48f8-bc59-d6786b716d5e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:21.164089 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e3808832-37e2-48f8-bc59-d6786b716d5e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Going to try to start instance {{(pid=127193) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 05:54:21.206951 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e3808832-37e2-48f8-bc59-d6786b716d5e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action" status: 202 len: 0 microversion: 2.1 time: 0.077684 Aug 24 05:54:21.207719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 507/1062] 10.222.0.73 () {60 vars in 1278 bytes} [Wed Aug 24 05:54:21 2022] POST /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:54:21.215916 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:21.216787 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:21.223716 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:21.224509 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:21.225169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:21.226015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:21.226892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:21.227628 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:21.378045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:21.386146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f658379a-a1ca-4727-bfca-54107e64a5b3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1661 microversion: 2.1 time: 0.174201 Aug 24 05:54:21.387614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 556/1063] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:21 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1661 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:54:22.409736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:22.410433 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:22.416978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:22.417477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:22.417987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:22.418681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:22.419134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:22.419554 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:22.556862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:22.564841 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4b8ff2e8-4191-4fc0-9275-d8ed2b3fdad3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1661 microversion: 2.1 time: 0.160299 Aug 24 05:54:22.565419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 508/1064] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:22 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1661 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:23.585945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:23.586563 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:23.593157 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:23.593684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:23.594371 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:23.595095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:23.595582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:23.596082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:23.726665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:23.734959 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0a04cfdc-5756-458f-917f-88f5afafae0e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1665 microversion: 2.1 time: 0.152751 Aug 24 05:54:23.735611 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 557/1065] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:23 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:26.090903 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:54:26.091395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 05:54:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:54:37.117960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:37.118587 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:37.120741 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=16 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:37.121681 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:37.122666 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-bf00e2f1-8711-442e-a834-d2d077f635db req-9bd4f741-24f0-4599-8131-c915a4b77dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "977405bb-cdcc-4b20-b7ae-754ab660c7c3", "tag": "477bcaf5-dea4-412c-a5c0-a5d8080b11f0"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:37.126424 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.126991 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.127434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.128142 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.128592 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.129025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.131293 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=16 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:37.132015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:37.134593 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-bf00e2f1-8711-442e-a834-d2d077f635db req-9bd4f741-24f0-4599-8131-c915a4b77dd6 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.135657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-bf00e2f1-8711-442e-a834-d2d077f635db req-9bd4f741-24f0-4599-8131-c915a4b77dd6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.135657 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-bf00e2f1-8711-442e-a834-d2d077f635db req-9bd4f741-24f0-4599-8131-c915a4b77dd6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.149104 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-bf00e2f1-8711-442e-a834-d2d077f635db req-9bd4f741-24f0-4599-8131-c915a4b77dd6 service nova] Creating event network-changed:477bcaf5-dea4-412c-a5c0-a5d8080b11f0 for instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 on hv-cinder-85426 Aug 24 05:54:37.155288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-bf00e2f1-8711-442e-a834-d2d077f635db req-9bd4f741-24f0-4599-8131-c915a4b77dd6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036118 Aug 24 05:54:37.155921 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 558/1066] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:37.163056 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:54:37.249532 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-291e991e-91fa-45a7-80e8-432bf5f9efca tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "DELETE /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 204 len: 0 microversion: 2.1 time: 0.135373 Aug 24 05:54:37.250632 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 509/1067] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:54:37 2022] DELETE /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:54:37.262314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:37.263321 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:37.274198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.274987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.275606 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.279743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:37.281062 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:37.281692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:37.420419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:37.428174 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e6eba3ec-b923-407d-80a7-f6c91d0c7fd9 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.170723 Aug 24 05:54:37.428739 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 559/1068] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:37 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:38.450084 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:38.450800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:38.457608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:38.458082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:38.458507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:38.459181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:38.459625 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:38.460038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:38.589399 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:38.597762 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c5b154de-7f90-49b7-943a-8b51158acc05 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1569 microversion: 2.1 time: 0.151302 Aug 24 05:54:38.598319 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 510/1069] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:38 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:39.619478 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:39.620088 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:39.626458 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:39.626944 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:39.627377 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:39.628075 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:39.628530 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:39.628950 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:39.772665 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:39.780185 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e320dba0-a946-4b1c-a693-fc89ea27de6a tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1451 microversion: 2.1 time: 0.164482 Aug 24 05:54:39.783688 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 560/1070] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:39 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:39.835209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-8a050e21-49f3-4950-bb5c-d13340816bf2 req-02f7682c-c131-4de4-afe5-0f77a607ee61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "977405bb-cdcc-4b20-b7ae-754ab660c7c3", "name": "network-vif-deleted", "tag": "477bcaf5-dea4-412c-a5c0-a5d8080b11f0"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:54:39.846757 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8a050e21-49f3-4950-bb5c-d13340816bf2 req-02f7682c-c131-4de4-afe5-0f77a607ee61 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:39.847892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8a050e21-49f3-4950-bb5c-d13340816bf2 req-02f7682c-c131-4de4-afe5-0f77a607ee61 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:39.848326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8a050e21-49f3-4950-bb5c-d13340816bf2 req-02f7682c-c131-4de4-afe5-0f77a607ee61 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:39.860377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-8a050e21-49f3-4950-bb5c-d13340816bf2 req-02f7682c-c131-4de4-afe5-0f77a607ee61 service nova] Creating event network-vif-deleted:477bcaf5-dea4-412c-a5c0-a5d8080b11f0 for instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 on hv-cinder-85426 Aug 24 05:54:39.865586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-8a050e21-49f3-4950-bb5c-d13340816bf2 req-02f7682c-c131-4de4-afe5-0f77a607ee61 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034432 Aug 24 05:54:39.866328 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 511/1071] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:54:40.801901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:40.802545 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:40.808768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:40.809248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:40.809712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:40.810406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:40.810859 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:40.811293 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:40.842574 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:40.843057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:40.843488 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:40.843929 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lazy-loading 'fault' on Instance uuid 977405bb-cdcc-4b20-b7ae-754ab660c7c3 {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:54:40.885915 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '135e823ff7f64beab0689c3a84cc268f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1406fa515f224f4b8507331fd22ea4fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:40.894177 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-38e47e75-9467-4574-b261-904eab27c119 tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 200 len: 1224 microversion: 2.1 time: 0.096521 Aug 24 05:54:40.895072 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 561/1072] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:40 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:54:41.916077 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:41.916774 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] [instance: 977405bb-cdcc-4b20-b7ae-754ab660c7c3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:41.923036 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:41.923520 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:41.923957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:41.924652 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:41.925107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:41.925535 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:41.939037 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] HTTP exception thrown: Instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 could not be found. Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Request method failure captured: Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 HTTP/1.1 Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbuxBJScuMTSIVnZ_cJ_LyFghU1c7iTSZO0F6JziVcWZ8Jl8qq1SXJm_SVtjPqQ8knvRLadLhvhOW63srfdX2kpTotvpZLSqdX8OmbGrXiQVO7CpD6phb0hEo0Fr4G1gV-Cav1EJ-Irf2foAnStgEHaf692iQt6eeurJzMk6QJ2JRcY Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 1406fa515f224f4b8507331fd22ea4fd Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-TestShelveInstance-2122088809 Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:54:41.941227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_1406fa515f224f4b8507331fd22ea4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/1406fa515f224f4b8507331fd22ea4fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1406fa515f224f4b8507331fd22ea4fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/1406fa515f224f4b8507331fd22ea4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-TestShelveInstance-2122088809 Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 1406fa515f224f4b8507331fd22ea4fd Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-TestShelveInstance-2122088809 Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-TestShelveInstance-2122088809-project Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 135e823ff7f64beab0689c3a84cc268f Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-TestShelveInstance-2122088809-project Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 could not be found. Aug 24 05:54:41.942994 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '977405bb-cdcc-4b20-b7ae-754ab660c7c3'} Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 could not be found. Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:54:41.944131 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 could not be found. Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 could not be found. Aug 24 05:54:41.945989 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:54:41.947501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Returning 404 to user: Instance 977405bb-cdcc-4b20-b7ae-754ab660c7c3 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:54:41.947501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3c0c5ad1-e2b9-4022-b8ef-2d81ee99a7fe tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3" status: 404 len: 111 microversion: 2.1 time: 0.031328 Aug 24 05:54:41.947501 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 512/1073] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:41 2022] GET /compute/v2.1/servers/977405bb-cdcc-4b20-b7ae-754ab660c7c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:54:42.098045 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-c0799891-16e6-4464-9d60-7bc28e97cbbb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] Calling method '.version_select at 0x7fa91c441af0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:42.119007 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-c0799891-16e6-4464-9d60-7bc28e97cbbb tempest-TestShelveInstance-2122088809 tempest-TestShelveInstance-2122088809-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1421150349" status: 202 len: 0 microversion: 2.1 time: 0.024774 Aug 24 05:54:42.119588 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 562/1074] 10.222.0.73 () {58 vars in 1254 bytes} [Wed Aug 24 05:54:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1421150349 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:54:59.085940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:59.088464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:59.094496 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:59.095720 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:59.097943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:59.098761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:59.099356 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:59.101087 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:59.101879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:59.102469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:59.148318 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8fe6b3ed-91fb-403f-9592-ca184f80a9c7 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065414 Aug 24 05:54:59.149518 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 513/1075] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:54:59 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:54:59.219050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=22 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:59.220661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:54:59.224984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:59.225484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:59.234221 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:59.234707 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:59.235139 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:59.239850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:59.242413 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:59.243038 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:59.276979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:54:59.398352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d0ecdda2-b7a1-439d-a194-012a426db0d2 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 204 len: 0 microversion: 2.1 time: 0.180431 Aug 24 05:54:59.399250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 563/1076] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:54:59 2022] DELETE /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:54:59.408091 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:54:59.408752 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:54:59.416032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:59.416518 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:59.417251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:59.418161 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:54:59.418617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:54:59.419070 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:54:59.683617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:54:59.697136 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ce20061f-b112-44e4-8e48-3c359d789175 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1671 microversion: 2.1 time: 0.293360 Aug 24 05:54:59.698690 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 514/1077] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:54:59 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:00.152940 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8a3be233-83a6-476c-b0bd-f0f5dce48d1b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Action: 'create', calling method: .version_select at 0x7fa91c285f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1214081369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEngIOek0DXI3hnK1T+BtxhP1wV8ZS0L2FDrHcQMY34CB4zZiekonhChbUvN+qdw4cn1aaPRaTTok47LkSalvXQzWPPu99m6INdw+F5bw0Qeg+BzlhymUrg65rjKXpNKWA=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:00.168525 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-8a3be233-83a6-476c-b0bd-f0f5dce48d1b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:55:00.175359 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-8a3be233-83a6-476c-b0bd-f0f5dce48d1b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for user 389ae44e6cfd4f5fbe56063e5b0ae787 and project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:55:00.199492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8a3be233-83a6-476c-b0bd-f0f5dce48d1b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.256899 Aug 24 05:55:00.200126 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 564/1078] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:54:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:00.722672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:00.723311 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:00.730179 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:00.730877 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:00.731310 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:00.732018 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:00.732470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:00.733140 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:00.907676 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:00.917238 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-34db100c-fe70-4aed-80ea-5bd0fc3fb0bc tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1671 microversion: 2.1 time: 0.201161 Aug 24 05:55:00.919560 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 515/1079] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:00 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1671 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:01.940847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:01.941782 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:01.949079 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:01.949676 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:01.950175 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:01.950925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:01.951586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:01.952228 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:02.117760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:02.126847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-df7695e8-6c1c-4363-8d2f-558ab933363d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 200 len: 1671 microversion: 2.1 time: 0.190160 Aug 24 05:55:02.128347 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 565/1080] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:01 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:02.416315 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-a03b8c06-d3e8-47da-8021-05118f009677 req-b20a9aa6-facc-4714-84e1-3e0c6a25003b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "748a59dc-9754-4a71-9f3d-754a13bf75f4", "name": "network-vif-deleted", "tag": "746dad8e-222e-4628-85ee-e98ed9e93dac"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:02.426685 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a03b8c06-d3e8-47da-8021-05118f009677 req-b20a9aa6-facc-4714-84e1-3e0c6a25003b service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:02.427160 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a03b8c06-d3e8-47da-8021-05118f009677 req-b20a9aa6-facc-4714-84e1-3e0c6a25003b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:02.427771 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-a03b8c06-d3e8-47da-8021-05118f009677 req-b20a9aa6-facc-4714-84e1-3e0c6a25003b service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:02.441239 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-a03b8c06-d3e8-47da-8021-05118f009677 req-b20a9aa6-facc-4714-84e1-3e0c6a25003b service nova] Creating event network-vif-deleted:746dad8e-222e-4628-85ee-e98ed9e93dac for instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 on hv-cinder-85426 Aug 24 05:55:02.448709 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-a03b8c06-d3e8-47da-8021-05118f009677 req-b20a9aa6-facc-4714-84e1-3e0c6a25003b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037097 Aug 24 05:55:02.449925 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 516/1081] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:03.149433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:03.150200 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:03.169446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:03.170296 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:03.170926 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:03.171831 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:03.172444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:03.173036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:03.196588 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] HTTP exception thrown: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Request method failure captured: Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 HTTP/1.1 Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbx_Wwp-6NNfABtbOHmPX1F1QVGmUFdoT14-LZHl_mF36f8WnMpPGoe7JxgefOYoOqNN55uTJoDfR3v2JKH2--IgiwCloswD1azIrnqu2gvj8l57-zkqnOfRWtXotoAAIwvnVpSVhnG0uib6J5tje1wbC23zQi58ThpCvdxgOImjODg Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:55:03.198720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 962fc6a6c7c04d6f93109c420c5aa6cd Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:55:03.200544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '748a59dc-9754-4a71-9f3d-754a13bf75f4'} Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:55:03.201619 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:55:03.203284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:55:03.206220 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Returning 404 to user: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:55:03.207508 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2bf746e9-b2b9-459c-9d1e-3543bb0f6ef9 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 404 len: 111 microversion: 2.1 time: 0.061959 Aug 24 05:55:03.208743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 566/1082] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:03 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:55:03.217420 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1375a106-feee-4dd1-b5c3-ab0bdf998ed0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '.version_select at 0x7fa91cc21430>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:03.245796 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1375a106-feee-4dd1-b5c3-ab0bdf998ed0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031354402" status: 202 len: 0 microversion: 2.1 time: 0.032480 Aug 24 05:55:03.247030 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 517/1083] 10.222.0.73 () {58 vars in 1221 bytes} [Wed Aug 24 05:55:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031354402 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:55:04.296796 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2ddc9504-d645-4028-8e47-0c60479e6edd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'create', calling method: .version_select at 0x7fa91c285d30>, body: {"keypair": {"name": "tempest-keypair-257202517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw0TEBMLRGiQbxa/h0sT43tUiN5fzhys75UdIAAzxQMaEgOzNUocoArfWnowwF+92Fn/6kouwNa3/KhHqNIrgXGzvstVIoHX2cmdYWkrO+pTRH48S14FtM/aWf8R0FwAA=="}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:04.314736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-2ddc9504-d645-4028-8e47-0c60479e6edd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for project b93f8c24b94841168ae2212ae15ecde9. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:55:04.318507 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-2ddc9504-d645-4028-8e47-0c60479e6edd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for user 962fc6a6c7c04d6f93109c420c5aa6cd and project b93f8c24b94841168ae2212ae15ecde9. Resources: {'key_pairs'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:55:04.339931 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2ddc9504-d645-4028-8e47-0c60479e6edd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046984 Aug 24 05:55:04.340709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 567/1084] 10.222.0.73 () {60 vars in 1159 bytes} [Wed Aug 24 05:55:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:05.668675 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-768312420", "imageRef": "1cb1585c-935d-4f0f-9476-2cc52a2033cb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b514a938-5fe8-487d-b4d3-71c1f2e13380"}], "security_groups": [{"name": "tempest-securitygroup--869534113"}], "key_name": "tempest-keypair-257202517", "user_data": "}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:05.772185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.network.neutron [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] validate_networks() for [('b514a938-5fe8-487d-b4d3-71c1f2e13380', None, None, None, None, None)] {{(pid=127193) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:55:06.144077 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Flavor limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:55:06.144510 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Image limits 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:55:06.144981 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Flavor pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:55:06.145381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Image pref 0:0:0 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:55:06.145856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.virt.hardware [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:55:06.154836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:06.155313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:06.155743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:06.156464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:06.156914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:06.157336 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:06.176482 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for project b93f8c24b94841168ae2212ae15ecde9. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:55:06.180371 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.quota [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Getting quotas for user 962fc6a6c7c04d6f93109c420c5aa6cd and project b93f8c24b94841168ae2212ae15ecde9. Resources: {'cores', 'instances', 'ram'} {{(pid=127193) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:55:06.191263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Going to run 1 instances... {{(pid=127193) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:55:06.193779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1cb1585c-935d-4f0f-9476-2cc52a2033cb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:55:06.244118 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e1bae1ab-0438-487c-8f11-98490780e369 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580567 Aug 24 05:55:06.244529 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 518/1085] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:55:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:55:06.257082 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-43285c3e-3d58-41ed-bd52-b6311d6053cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:06.257850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-43285c3e-3d58-41ed-bd52-b6311d6053cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:06.323415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-43285c3e-3d58-41ed-bd52-b6311d6053cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:06.332247 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-43285c3e-3d58-41ed-bd52-b6311d6053cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1236 microversion: 2.1 time: 0.079081 Aug 24 05:55:06.332825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 568/1086] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:06 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:07.357227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:07.357227 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:07.364168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:07.364694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:07.365139 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:07.365876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:07.366334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:07.366761 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:07.435406 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:07.444319 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-33380b15-acdc-4456-a465-02c81cfb0856 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1306 microversion: 2.1 time: 0.093174 Aug 24 05:55:07.445385 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 519/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:07 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:08.466359 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:08.467007 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:08.473968 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:08.474455 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:08.474890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:08.475586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:08.476038 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:08.476620 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:08.612748 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:08.620395 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d47f1fe5-f6e4-4938-b1e6-3f3951658845 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1361 microversion: 2.1 time: 0.157939 Aug 24 05:55:08.620962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 569/1088] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:08 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:08.770166 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-5c4e4d6a-4bd9-43bb-9c18-8153cae760a1 req-9595243e-7920-4969-87dc-1c8592b031a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341884aa-e088-4e72-96cc-950853e9a0b3", "tag": "51f9c0fe-37e0-4d10-bdfc-8254ea32bea8"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:08.783025 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-5c4e4d6a-4bd9-43bb-9c18-8153cae760a1 req-9595243e-7920-4969-87dc-1c8592b031a2 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:08.783511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-5c4e4d6a-4bd9-43bb-9c18-8153cae760a1 req-9595243e-7920-4969-87dc-1c8592b031a2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:08.783945 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-5c4e4d6a-4bd9-43bb-9c18-8153cae760a1 req-9595243e-7920-4969-87dc-1c8592b031a2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:08.794958 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-5c4e4d6a-4bd9-43bb-9c18-8153cae760a1 req-9595243e-7920-4969-87dc-1c8592b031a2 service nova] Creating event network-changed:51f9c0fe-37e0-4d10-bdfc-8254ea32bea8 for instance 341884aa-e088-4e72-96cc-950853e9a0b3 on hv-cinder-85426 Aug 24 05:55:08.800127 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-5c4e4d6a-4bd9-43bb-9c18-8153cae760a1 req-9595243e-7920-4969-87dc-1c8592b031a2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034629 Aug 24 05:55:08.800843 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 520/1089] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:09.641341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:09.641978 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:09.648478 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:09.648969 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:09.649402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:09.650124 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:09.650582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:09.651006 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:09.789955 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:09.797712 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-04254b79-94f2-4938-8920-7e87f1e04f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1361 microversion: 2.1 time: 0.160149 Aug 24 05:55:09.798284 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 570/1090] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:09 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:10.821797 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:10.822498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:10.829827 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:10.830457 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:10.830739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:10.831434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:10.831879 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:10.832298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:10.967315 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:10.975533 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-76b8b813-2ebe-4616-a847-eb9760641f22 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1361 microversion: 2.1 time: 0.158937 Aug 24 05:55:10.976103 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 521/1091] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:10 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:55:11.996952 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:11.997686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:12.004242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:12.004726 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:12.005161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:12.005873 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:12.006333 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:12.006756 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:12.132419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:12.140298 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-907a14c9-877c-4622-ae79-7393cf4ffa30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1361 microversion: 2.1 time: 0.147153 Aug 24 05:55:12.140869 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 571/1092] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:11 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:12.992886 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-31c022ac-780a-45c9-b28f-fc47a7ac44cc req-fc1b8045-d814-40d0-b803-046350a6fab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341884aa-e088-4e72-96cc-950853e9a0b3", "name": "network-vif-plugged", "status": "completed", "tag": "51f9c0fe-37e0-4d10-bdfc-8254ea32bea8"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:13.003902 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-31c022ac-780a-45c9-b28f-fc47a7ac44cc req-fc1b8045-d814-40d0-b803-046350a6fab8 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:13.004563 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-31c022ac-780a-45c9-b28f-fc47a7ac44cc req-fc1b8045-d814-40d0-b803-046350a6fab8 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:13.005890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-31c022ac-780a-45c9-b28f-fc47a7ac44cc req-fc1b8045-d814-40d0-b803-046350a6fab8 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:13.017734 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-31c022ac-780a-45c9-b28f-fc47a7ac44cc req-fc1b8045-d814-40d0-b803-046350a6fab8 service nova] Creating event network-vif-plugged:51f9c0fe-37e0-4d10-bdfc-8254ea32bea8 for instance 341884aa-e088-4e72-96cc-950853e9a0b3 on hv-cinder-85426 Aug 24 05:55:13.022957 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-31c022ac-780a-45c9-b28f-fc47a7ac44cc req-fc1b8045-d814-40d0-b803-046350a6fab8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033908 Aug 24 05:55:13.023343 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 522/1093] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:13.160932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:13.162161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:13.169057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:13.169605 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:13.170154 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:13.170921 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:13.171379 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:13.171906 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:13.307677 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:13.315432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-da1a25ae-2792-4281-803c-82fd95c54753 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1361 microversion: 2.1 time: 0.158417 Aug 24 05:55:13.315999 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 572/1094] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:13 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:14.336805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:14.337507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:14.344149 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:14.344636 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:14.345069 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:14.345791 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:14.346249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:14.346674 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:14.474507 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:14.482386 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d99a6b14-dab6-4c0a-966d-a5690296fabd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1361 microversion: 2.1 time: 0.149790 Aug 24 05:55:14.483386 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 523/1095] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:14 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:15.504842 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:15.505482 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:15.511801 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:15.512279 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:15.512717 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:15.513409 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:15.513888 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:15.514311 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:15.651761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:15.659352 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1ecc82cb-b92b-4668-94b2-f094b9295634 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1547 microversion: 2.1 time: 0.158965 Aug 24 05:55:15.659925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 573/1096] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:15 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:15.680268 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:15.680789 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:15.687183 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:15.687672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:15.688178 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:15.688872 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:15.689324 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:15.690341 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:15.769694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-88f51f89-24ca-4877-b176-3cb3bc87e3ad tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093273 Aug 24 05:55:15.770292 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 524/1097] 10.222.0.73 () {58 vars in 1275 bytes} [Wed Aug 24 05:55:15 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:16.762120 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-974434643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1214081369", "security_groups": [{"name": "tempest-secgroup-smoke-1514284810"}], "block_device_mapping_v2": [{"uuid": "66dc55f1-bbba-4a7d-8008-1e26a62c8dfd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a20f248-f558-4ed2-854a-73b79351018a"}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:16.772759 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=10 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:16.879239 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] validate_networks() for [('3a20f248-f558-4ed2-854a-73b79351018a', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:55:16.943856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:16.944626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=6 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:16.949269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-dc0cc87a-58bc-47e6-8a0f-91746245e06a req-f67da432-97f1-4ea0-b470-cae62136f848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "341884aa-e088-4e72-96cc-950853e9a0b3", "tag": "51f9c0fe-37e0-4d10-bdfc-8254ea32bea8"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:16.960115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-dc0cc87a-58bc-47e6-8a0f-91746245e06a req-f67da432-97f1-4ea0-b470-cae62136f848 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:16.960589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-dc0cc87a-58bc-47e6-8a0f-91746245e06a req-f67da432-97f1-4ea0-b470-cae62136f848 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:16.961012 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-dc0cc87a-58bc-47e6-8a0f-91746245e06a req-f67da432-97f1-4ea0-b470-cae62136f848 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:16.973766 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-dc0cc87a-58bc-47e6-8a0f-91746245e06a req-f67da432-97f1-4ea0-b470-cae62136f848 service nova] Creating event network-changed:51f9c0fe-37e0-4d10-bdfc-8254ea32bea8 for instance 341884aa-e088-4e72-96cc-950853e9a0b3 on hv-cinder-85426 Aug 24 05:55:16.977901 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-dc0cc87a-58bc-47e6-8a0f-91746245e06a req-f67da432-97f1-4ea0-b470-cae62136f848 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034667 Aug 24 05:55:16.978499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 525/1098] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:55:17.278865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:55:17.279378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:55:17.279908 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:55:17.280383 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:55:17.280793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:55:17.290161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:17.290937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:17.291372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:17.292097 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:17.292542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:17.293043 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:17.310707 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:55:17.315246 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for user 389ae44e6cfd4f5fbe56063e5b0ae787 and project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:55:17.375565 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:55:17.378230 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66dc55f1-bbba-4a7d-8008-1e26a62c8dfd',volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:55:17.529586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-335167dc-4af3-4632-b236-4cd6ca1c52b6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.771249 Aug 24 05:55:17.530464 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 574/1099] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:55:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 05:55:17.542079 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ffc06a5f-a74b-4ef0-aea8-c6e5daef47ca tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:17.543064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ffc06a5f-a74b-4ef0-aea8-c6e5daef47ca tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:17.610655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ffc06a5f-a74b-4ef0-aea8-c6e5daef47ca tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:17.618836 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ffc06a5f-a74b-4ef0-aea8-c6e5daef47ca tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1094 microversion: 2.1 time: 0.081043 Aug 24 05:55:17.619845 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 526/1100] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:17 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:18.643227 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:18.644172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:18.652902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:18.653385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:18.653868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:18.654717 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:18.655178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:18.655601 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:18.725754 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:18.734640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cc91c182-33e4-403d-aadd-8a0003980a2d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1210 microversion: 2.1 time: 0.097072 Aug 24 05:55:18.735211 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 575/1101] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:18 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:19.754892 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:19.755622 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:19.763697 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:19.764185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:19.764616 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:19.765305 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:19.765867 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:19.766284 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:19.962800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:19.971716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-af03f699-79f9-43c0-b32b-da9831ebf2cd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.220045 Aug 24 05:55:19.972367 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 527/1102] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:19 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:20.013288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-ab082cc2-3b4c-4c45-9d8e-c6e7a16df64f req-6e7cd8c5-f895-4b76-987a-48c944e5e0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4556e949-3ebd-4453-9406-907389fb9d6a", "tag": "4eac820b-0992-4e52-954f-fdfb91542152"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:20.024825 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-ab082cc2-3b4c-4c45-9d8e-c6e7a16df64f req-6e7cd8c5-f895-4b76-987a-48c944e5e0d2 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:20.025314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-ab082cc2-3b4c-4c45-9d8e-c6e7a16df64f req-6e7cd8c5-f895-4b76-987a-48c944e5e0d2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:20.025795 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-ab082cc2-3b4c-4c45-9d8e-c6e7a16df64f req-6e7cd8c5-f895-4b76-987a-48c944e5e0d2 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:20.036824 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-ab082cc2-3b4c-4c45-9d8e-c6e7a16df64f req-6e7cd8c5-f895-4b76-987a-48c944e5e0d2 service nova] Creating event network-changed:4eac820b-0992-4e52-954f-fdfb91542152 for instance 4556e949-3ebd-4453-9406-907389fb9d6a on hv-cinder-85426 Aug 24 05:55:20.042077 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-ab082cc2-3b4c-4c45-9d8e-c6e7a16df64f req-6e7cd8c5-f895-4b76-987a-48c944e5e0d2 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032480 Aug 24 05:55:20.042696 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 576/1103] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:20.993035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:20.993678 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:21.000065 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:21.000545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:21.000981 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:21.001710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:21.002207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:21.002631 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:21.227878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:21.236132 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ed6d7799-e79d-4e56-bc72-311161a0b548 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.246940 Aug 24 05:55:21.236881 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 528/1104] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:20 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:22.257299 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:22.258022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:22.264254 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:22.264736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:22.265180 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:22.265987 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:22.266444 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:22.266898 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:22.399106 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:22.406692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a80c9ab5-f671-4a47-b245-5cafb037afb2 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.154170 Aug 24 05:55:22.407259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 577/1105] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:22 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:23.428238 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:23.429014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:23.435559 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:23.436040 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:23.436475 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:23.437167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:23.437648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:23.438076 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:23.566444 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:23.574277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d80326e4-667a-42b0-98b7-305b9b89891b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.150409 Aug 24 05:55:23.574842 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 529/1106] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:23 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:24.594854 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:24.595492 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:24.602026 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:24.602497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:24.602925 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:24.603632 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:24.604074 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:24.604489 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:24.733294 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:24.740850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b99ec27c-7fd1-431a-9448-f139854d626f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.149835 Aug 24 05:55:24.741407 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 578/1107] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:24 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:25.761545 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:25.762181 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:25.768645 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:25.769128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:25.769583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:25.770285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:25.770742 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:25.771169 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:25.897711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:25.905495 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e76cd43e-6e51-478a-8a07-175802eff8bc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.147831 Aug 24 05:55:25.906095 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 530/1108] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:25 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:26.925961 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:26.926577 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:26.933033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:26.933595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:26.934037 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:26.934734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:26.935188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:26.935610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:27.070516 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:27.078837 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-68414bd0-8237-44ff-a450-44f284f1b9d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.156697 Aug 24 05:55:27.079615 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 579/1109] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:26 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:28.100575 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:28.101182 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:28.103337 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:28.109100 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:28.109588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:28.110026 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:28.110711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:28.111651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:28.112068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:28.244017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:28.251730 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-b9f7a150-e372-4f3f-abbf-7fe1d5e7fb52 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.155318 Aug 24 05:55:28.252291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 531/1110] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:28 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:29.097429 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-b7dfff2a-d859-4406-a92b-773331dc550b req-89776098-5a0b-46a5-b64a-d5959107a9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4556e949-3ebd-4453-9406-907389fb9d6a", "name": "network-vif-plugged", "status": "completed", "tag": "4eac820b-0992-4e52-954f-fdfb91542152"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:29.102264 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.103259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=6 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.111055 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b7dfff2a-d859-4406-a92b-773331dc550b req-89776098-5a0b-46a5-b64a-d5959107a9e6 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:29.111521 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b7dfff2a-d859-4406-a92b-773331dc550b req-89776098-5a0b-46a5-b64a-d5959107a9e6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:29.111943 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-b7dfff2a-d859-4406-a92b-773331dc550b req-89776098-5a0b-46a5-b64a-d5959107a9e6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:29.123735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-b7dfff2a-d859-4406-a92b-773331dc550b req-89776098-5a0b-46a5-b64a-d5959107a9e6 service nova] Creating event network-vif-plugged:4eac820b-0992-4e52-954f-fdfb91542152 for instance 4556e949-3ebd-4453-9406-907389fb9d6a on hv-cinder-85426 Aug 24 05:55:29.129077 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-b7dfff2a-d859-4406-a92b-773331dc550b req-89776098-5a0b-46a5-b64a-d5959107a9e6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035963 Aug 24 05:55:29.129980 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 580/1111] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:29.272474 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:29.273504 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:29.275345 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.281464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:29.282016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:29.282459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:29.283158 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:29.283608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:29.284032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:29.458806 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:29.461048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=85 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:29.468068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e5271993-986d-45e9-ae43-9ede8373e528 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.199368 Aug 24 05:55:29.468651 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 532/1112] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:29 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:30.490757 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:30.491453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:30.493368 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:30.498812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:30.499289 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:30.499721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:30.500416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:30.500865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:30.501281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:30.504973 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:30.645059 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:30.653039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8c7d92f2-94eb-4e0c-985c-a253eddaf8e8 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1266 microversion: 2.1 time: 0.168125 Aug 24 05:55:30.653626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 581/1113] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:30 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:31.674751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:31.675363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:31.682034 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:31.682514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:31.682949 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:31.683664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:31.684114 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:31.684537 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:31.819277 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:31.826946 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-fdd71f72-0052-478b-abb1-e4c38d921674 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1452 microversion: 2.1 time: 0.156523 Aug 24 05:55:31.827509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 533/1114] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:31 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:31.847363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:31.848067 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:31.854498 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:31.854983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:31.855416 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:31.856104 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:31.856557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:31.856981 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:31.984415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:55:31.992713 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-91e5ab38-141b-4126-84b4-9143ad638ec0 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1452 microversion: 2.1 time: 0.149219 Aug 24 05:55:31.993478 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 582/1115] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:55:31 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:55:33.883708 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-dddbfa09-fd9c-4dcc-99cf-27ccf523fbd0 req-5c5bcdb8-742d-4f8c-82cc-1916f37e2483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4556e949-3ebd-4453-9406-907389fb9d6a", "tag": "4eac820b-0992-4e52-954f-fdfb91542152"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:33.893732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-dddbfa09-fd9c-4dcc-99cf-27ccf523fbd0 req-5c5bcdb8-742d-4f8c-82cc-1916f37e2483 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:33.894220 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-dddbfa09-fd9c-4dcc-99cf-27ccf523fbd0 req-5c5bcdb8-742d-4f8c-82cc-1916f37e2483 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:33.894648 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-dddbfa09-fd9c-4dcc-99cf-27ccf523fbd0 req-5c5bcdb8-742d-4f8c-82cc-1916f37e2483 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:33.905414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-dddbfa09-fd9c-4dcc-99cf-27ccf523fbd0 req-5c5bcdb8-742d-4f8c-82cc-1916f37e2483 service nova] Creating event network-changed:4eac820b-0992-4e52-954f-fdfb91542152 for instance 4556e949-3ebd-4453-9406-907389fb9d6a on hv-cinder-85426 Aug 24 05:55:33.911500 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-dddbfa09-fd9c-4dcc-99cf-27ccf523fbd0 req-5c5bcdb8-742d-4f8c-82cc-1916f37e2483 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031000 Aug 24 05:55:33.911655 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 534/1116] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:55:51.961385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:55:51.962032 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:51.964080 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:51.964724 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=11 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:51.970555 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:51.971039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:51.971476 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:51.972172 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:51.972627 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:51.973049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:51.996662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-81e747a7-0e8d-4547-a006-a7b77898cf32 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/ips" status: 200 len: 146 microversion: 2.1 time: 0.039130 Aug 24 05:55:51.997240 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 583/1117] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:55:51 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:55:53.315154 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=5 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:53.315894 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=9 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:55:53.320297 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee1129b2-ddf8-444f-bce5-802464739dbe"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:55:53.322716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:55:53.329551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:53.330060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:53.330499 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:53.331191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:55:53.332134 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:55:53.332560 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:55:53.690559 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3cbc0261-bacb-4f47-9a48-9a0a1e81d1cf tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376562 Aug 24 05:55:53.691834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 535/1118] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:55:53 2022] POST /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:01.207559 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:01.209734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:01.216163 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:01.216646 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:01.217078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:01.217797 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:01.218245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:01.218666 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:01.251678 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f26778f4-3875-4e1f-9c8d-22de5b5d9d1d tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048167 Aug 24 05:56:01.252252 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 584/1119] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:56:01 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:01.264271 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:01.264850 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:01.271269 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:01.271751 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:01.272448 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:01.272904 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:01.273357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:01.273805 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:01.303483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a4029399-e9ac-4537-bdc9-2fad494513fb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/ee1129b2-ddf8-444f-bce5-802464739dbe" status: 200 len: 194 microversion: 2.1 time: 0.044021 Aug 24 05:56:01.304078 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 536/1120] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 05:56:01 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/ee1129b2-ddf8-444f-bce5-802464739dbe => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:02.664195 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ee115f7-96e8-4d01-90d9-fd69b75b752b"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:02.667673 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:02.678259 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:02.678707 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:02.679356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:02.680428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:02.681119 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:02.681803 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:03.227162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9e2284c5-d3bf-4253-aba4-ab68ed988b13 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "POST /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568687 Aug 24 05:56:03.227790 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 585/1121] 10.222.0.73 () {60 vars in 1323 bytes} [Wed Aug 24 05:56:02 2022] POST /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:10.751396 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:10.753811 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:10.760511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:10.760987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:10.761418 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:10.762151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:10.762598 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:10.763019 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:10.793715 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-93f808ac-ea44-48aa-abe1-70c3964e5d92 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046267 Aug 24 05:56:10.794273 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 537/1122] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:56:10 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:10.952133 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:10.953188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:10.959757 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:10.960242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:10.960684 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:10.961381 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:10.961868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:10.962293 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:10.992769 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0188b550-37b7-4cc4-aa72-014a5e674d7b tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/ee1129b2-ddf8-444f-bce5-802464739dbe" status: 200 len: 194 microversion: 2.1 time: 0.045506 Aug 24 05:56:10.993358 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 586/1123] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 05:56:10 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/ee1129b2-ddf8-444f-bce5-802464739dbe => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:11.003750 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:11.004250 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:11.011363 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.011846 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.012285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.012987 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:11.013445 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:11.013896 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:11.096683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lazy-loading 'services' on Instance uuid 341884aa-e088-4e72-96cc-950853e9a0b3 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:56:11.170383 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-dd804195-7d9b-4782-b5b4-f571c572dcc5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/ee1129b2-ddf8-444f-bce5-802464739dbe" status: 202 len: 0 microversion: 2.1 time: 0.170426 Aug 24 05:56:11.170963 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 538/1124] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:56:10 2022] DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/ee1129b2-ddf8-444f-bce5-802464739dbe => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:56:12.290650 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:12.291139 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:12.297611 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.298090 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.298523 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.299193 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.299637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.300050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.328450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1274eacd-959b-40db-b84c-4ecbb6646ec3 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/0ee115f7-96e8-4d01-90d9-fd69b75b752b" status: 200 len: 194 microversion: 2.1 time: 0.042522 Aug 24 05:56:12.329034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 587/1125] 10.222.0.73 () {58 vars in 1413 bytes} [Wed Aug 24 05:56:12 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/0ee115f7-96e8-4d01-90d9-fd69b75b752b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:12.340972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:12.341556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:12.347760 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.348246 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.349382 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.350384 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:12.352035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:12.352035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:12.433226 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.objects.instance [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lazy-loading 'services' on Instance uuid 341884aa-e088-4e72-96cc-950853e9a0b3 {{(pid=127193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:56:12.503032 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-9f9e0d6d-5af8-4e56-b638-dc37cecba4dd tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/0ee115f7-96e8-4d01-90d9-fd69b75b752b" status: 202 len: 0 microversion: 2.1 time: 0.166603 Aug 24 05:56:12.503634 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 539/1126] 10.222.0.73 () {58 vars in 1416 bytes} [Wed Aug 24 05:56:12 2022] DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments/0ee115f7-96e8-4d01-90d9-fd69b75b752b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:56:13.670142 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:13.672723 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:13.679412 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.679886 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.680312 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.680994 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.681441 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.681882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.711899 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-836a705b-6242-4220-8175-e8f23398bf30 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045641 Aug 24 05:56:13.712450 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 588/1127] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:56:13 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:56:13.823207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:13.825538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:13.831690 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.832167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.832600 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.833856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.834285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.834702 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.865265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c3401eed-59e5-412e-8878-6884f81aa1e8 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046720 Aug 24 05:56:13.865852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 540/1128] 10.222.0.73 () {58 vars in 1302 bytes} [Wed Aug 24 05:56:13 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:56:13.928388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:13.928388 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:13.933285 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.933793 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.934219 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.934902 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:13.935345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:13.935767 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:13.960682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:56:14.035703 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5a1793f9-8fc3-4894-a966-3069519ea94f tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 204 len: 0 microversion: 2.1 time: 0.112259 Aug 24 05:56:14.036314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 589/1129] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:56:13 2022] DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:56:14.044874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:14.045485 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:14.051459 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.051944 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.052383 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.053075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:14.053626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:14.054059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:14.186060 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:14.194204 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f0f84918-d347-4a2a-a538-195e27783ef0 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1672 microversion: 2.1 time: 0.153280 Aug 24 05:56:14.194769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 541/1130] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:14 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:15.215937 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:15.216608 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:15.223015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.224164 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.224807 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.225502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:15.226036 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:15.226454 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:15.358849 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:15.366640 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f25832c6-dcad-47b7-830d-7248d25941d5 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1672 microversion: 2.1 time: 0.155032 Aug 24 05:56:15.367196 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 590/1131] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:15 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:16.387919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:16.388647 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:16.394986 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.395539 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.396091 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.396795 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.397252 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.397693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.486394 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '962fc6a6c7c04d6f93109c420c5aa6cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93f8c24b94841168ae2212ae15ecde9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:56:16.494148 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-7a9bb546-5c3f-4ae6-92e2-1f8f59aba83c tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 200 len: 1605 microversion: 2.1 time: 0.110057 Aug 24 05:56:16.494706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 542/1132] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:16 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 1605 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:56:16.747373 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-62cf69a5-cb20-4b79-b6a1-398d55f320b9 req-2d99297a-3b0b-4519-ac85-d112bec08ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "341884aa-e088-4e72-96cc-950853e9a0b3", "name": "network-vif-deleted", "tag": "51f9c0fe-37e0-4d10-bdfc-8254ea32bea8"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:16.757624 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-62cf69a5-cb20-4b79-b6a1-398d55f320b9 req-2d99297a-3b0b-4519-ac85-d112bec08ed5 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:16.758983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-62cf69a5-cb20-4b79-b6a1-398d55f320b9 req-2d99297a-3b0b-4519-ac85-d112bec08ed5 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:16.758983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-62cf69a5-cb20-4b79-b6a1-398d55f320b9 req-2d99297a-3b0b-4519-ac85-d112bec08ed5 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:16.770760 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-62cf69a5-cb20-4b79-b6a1-398d55f320b9 req-2d99297a-3b0b-4519-ac85-d112bec08ed5 service nova] Creating event network-vif-deleted:51f9c0fe-37e0-4d10-bdfc-8254ea32bea8 for instance 341884aa-e088-4e72-96cc-950853e9a0b3 on hv-cinder-85426 Aug 24 05:56:16.776384 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-62cf69a5-cb20-4b79-b6a1-398d55f320b9 req-2d99297a-3b0b-4519-ac85-d112bec08ed5 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032663 Aug 24 05:56:16.777021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 591/1133] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:17.516395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:17.517031 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:17.523834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:17.524315 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:17.524753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:17.525497 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:17.525976 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:17.526397 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:17.540538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] HTTP exception thrown: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Request method failure captured: Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 HTTP/1.1 Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbx_Wwp-6NNfABtbOHmPX1F1QVGmUFdoT14-LZHl_mF36f8WnMpPGoe7JxgefOYoOqNN55uTJoDfR3v2JKH2--IgiwCloswD1azIrnqu2gvj8l57-zkqnOfRWtXotoAAIwvnVpSVhnG0uib6J5tje1wbC23zQi58ThpCvdxgOImjODg Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:56:17.542251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 962fc6a6c7c04d6f93109c420c5aa6cd Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:17.543960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '341884aa-e088-4e72-96cc-950853e9a0b3'} Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:17.544870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:17.546550 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:17.548261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Returning 404 to user: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:17.548261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a5d2d8e6-9250-41b9-bcb3-172a36ee653a tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 404 len: 111 microversion: 2.1 time: 0.031234 Aug 24 05:56:17.548261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 543/1134] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:17 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:17.554034 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-8d2464e0-99a1-4133-a1d8-08e988d585ea tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '.version_select at 0x7fa91c4bedc0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:17.574007 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-8d2464e0-99a1-4133-a1d8-08e988d585ea tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-257202517" status: 202 len: 0 microversion: 2.1 time: 0.024774 Aug 24 05:56:17.574587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 592/1135] 10.222.0.73 () {58 vars in 1218 bytes} [Wed Aug 24 05:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-257202517 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:56:20.476541 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:20.477102 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:20.484051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.484511 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.484940 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.485672 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.486111 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.486527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.499733 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] HTTP exception thrown: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Request method failure captured: Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 HTTP/1.1 Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbx_Wwp-6NNfABtbOHmPX1F1QVGmUFdoT14-LZHl_mF36f8WnMpPGoe7JxgefOYoOqNN55uTJoDfR3v2JKH2--IgiwCloswD1azIrnqu2gvj8l57-zkqnOfRWtXotoAAIwvnVpSVhnG0uib6J5tje1wbC23zQi58ThpCvdxgOImjODg Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:56:20.501253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 962fc6a6c7c04d6f93109c420c5aa6cd Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.502769 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '341884aa-e088-4e72-96cc-950853e9a0b3'} Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:20.503573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.505097 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.507072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Returning 404 to user: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:20.507072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c3180b49-8f86-4dd5-abbb-577b7d4af75e tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 404 len: 111 microversion: 2.1 time: 0.031286 Aug 24 05:56:20.507072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 544/1136] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:56:20 2022] DELETE /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:20.511620 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:20.512355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 341884aa-e088-4e72-96cc-950853e9a0b3] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:20.518960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.519439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.519871 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.521063 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:20.521618 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:20.522049 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:20.535380 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] HTTP exception thrown: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Request method failure captured: Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 HTTP/1.1 Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbx_Wwp-6NNfABtbOHmPX1F1QVGmUFdoT14-LZHl_mF36f8WnMpPGoe7JxgefOYoOqNN55uTJoDfR3v2JKH2--IgiwCloswD1azIrnqu2gvj8l57-zkqnOfRWtXotoAAIwvnVpSVhnG0uib6J5tje1wbC23zQi58ThpCvdxgOImjODg Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:56:20.537768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 962fc6a6c7c04d6f93109c420c5aa6cd Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.539402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '341884aa-e088-4e72-96cc-950853e9a0b3'} Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:20.540446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. Aug 24 05:56:20.541711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:20.543169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Returning 404 to user: Instance 341884aa-e088-4e72-96cc-950853e9a0b3 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:20.543169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-405d80af-573a-477c-a1c8-29a513dbe7bb tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3" status: 404 len: 111 microversion: 2.1 time: 0.031875 Aug 24 05:56:20.543169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 593/1137] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:20 2022] GET /compute/v2.1/servers/341884aa-e088-4e72-96cc-950853e9a0b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:21.687172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:21.687706 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:21.694167 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.694641 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.695064 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.695745 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.696193 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.696608 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.710390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] HTTP exception thrown: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Request method failure captured: Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 HTTP/1.1 Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBbx_Wwp-6NNfABtbOHmPX1F1QVGmUFdoT14-LZHl_mF36f8WnMpPGoe7JxgefOYoOqNN55uTJoDfR3v2JKH2--IgiwCloswD1azIrnqu2gvj8l57-zkqnOfRWtXotoAAIwvnVpSVhnG0uib6J5tje1wbC23zQi58ThpCvdxgOImjODg Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:56:21.711911 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 962fc6a6c7c04d6f93109c420c5aa6cd Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.713301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '748a59dc-9754-4a71-9f3d-754a13bf75f4'} Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:21.714110 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.715556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.717180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Returning 404 to user: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:21.717180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-381a258d-fd46-4ede-be73-e8c355107fba tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "DELETE /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 404 len: 111 microversion: 2.1 time: 0.029970 Aug 24 05:56:21.717180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 545/1138] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:56:21 2022] DELETE /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:21.721692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:21.722336 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] [instance: 748a59dc-9754-4a71-9f3d-754a13bf75f4] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:56:21.732162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.732896 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.733331 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.734071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:56:21.734522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:56:21.734945 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:56:21.748735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] HTTP exception thrown: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Request method failure captured: Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 HTTP/1.1 Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBbx_Wwp-6NNfABtbOHmPX1F1QVGmUFdoT14-LZHl_mF36f8WnMpPGoe7JxgefOYoOqNN55uTJoDfR3v2JKH2--IgiwCloswD1azIrnqu2gvj8l57-zkqnOfRWtXotoAAIwvnVpSVhnG0uib6J5tje1wbC23zQi58ThpCvdxgOImjODg Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:56:21.751402 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/b93f8c24b94841168ae2212ae15ecde9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: b93f8c24b94841168ae2212ae15ecde9 Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-AttachVolumeTestJSON-944359310 Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 962fc6a6c7c04d6f93109c420c5aa6cd Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-AttachVolumeTestJSON-944359310-project Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.754497 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '748a59dc-9754-4a71-9f3d-754a13bf75f4'} Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:21.755428 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. Aug 24 05:56:21.756960 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:21.758798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] Returning 404 to user: Instance 748a59dc-9754-4a71-9f3d-754a13bf75f4 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:21.758798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a2df720a-7dff-40de-98bf-81d2237d92d4 tempest-AttachVolumeTestJSON-944359310 tempest-AttachVolumeTestJSON-944359310-project] 10.222.0.73 "GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4" status: 404 len: 111 microversion: 2.1 time: 0.033953 Aug 24 05:56:21.758798 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 594/1139] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:56:21 2022] GET /compute/v2.1/servers/748a59dc-9754-4a71-9f3d-754a13bf75f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:26.038089 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e82d7670-ee9e-4753-8996-34798ca33847 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Action: 'create', calling method: .version_select at 0x7fa91c242b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-346312586"}} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:26.321916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e82d7670-ee9e-4753-8996-34798ca33847 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.398296 Aug 24 05:56:26.322766 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 546/1140] 10.222.0.73 () {60 vars in 1155 bytes} [Wed Aug 24 05:56:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 05:56:26.334840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-917820ab-491f-487d-b781-1be1f0fb7e30 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c4beee0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:26.388273 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-917820ab-491f-487d-b781-1be1f0fb7e30 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190" status: 200 len: 344 microversion: 2.1 time: 0.057158 Aug 24 05:56:26.388839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 595/1141] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:56:26 2022] GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:56:27.403038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-6ffc4640-acdf-471c-9444-1381d36098bd tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91cc36e50>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:27.449710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-6ffc4640-acdf-471c-9444-1381d36098bd tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190" status: 200 len: 345 microversion: 2.1 time: 0.050956 Aug 24 05:56:27.450272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 547/1142] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:56:27 2022] GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:27.463729 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-aaa6ec6c-ab72-4eca-a5a1-53fb0e3927e2 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Action: 'create', calling method: .version_select at 0x7fa91c46ba60>, body: {"snapshot": {"volume_id": "be9595f2-29c7-423c-a75a-5c2d4c46c190", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1051973662"}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:56:27.617686 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-aaa6ec6c-ab72-4eca-a5a1-53fb0e3927e2 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.158104 Aug 24 05:56:27.618345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 596/1143] 10.222.0.73 () {60 vars in 1162 bytes} [Wed Aug 24 05:56:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:56:27.628918 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e4da6791-d858-498c-a326-9b846972d130 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c242160>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:27.659754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e4da6791-d858-498c-a326-9b846972d130 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 200 len: 287 microversion: 2.1 time: 0.034562 Aug 24 05:56:27.660353 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 548/1144] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 05:56:27 2022] GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:27.671219 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-237c6286-a6c3-4dec-bb48-b4119fdf94ba tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c357b80>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:27.702209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-237c6286-a6c3-4dec-bb48-b4119fdf94ba tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034908 Aug 24 05:56:27.702809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 597/1145] 10.222.0.73 () {58 vars in 1140 bytes} [Wed Aug 24 05:56:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:27.714156 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-a6f31d65-100e-477b-adac-da5bc9a943dd tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91cc45ca0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:27.743746 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-a6f31d65-100e-477b-adac-da5bc9a943dd tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 200 len: 287 microversion: 2.1 time: 0.033389 Aug 24 05:56:27.744325 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 549/1146] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 05:56:27 2022] GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:28.756614 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-316de089-9ff2-4568-bcee-8234bf92a7c1 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c4ced30>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:28.789060 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-316de089-9ff2-4568-bcee-8234bf92a7c1 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 200 len: 287 microversion: 2.1 time: 0.036774 Aug 24 05:56:28.789740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 598/1147] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 05:56:28 2022] GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:29.803161 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-d51adc4c-875a-47b9-8286-a50b00ec7bfb tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91cdc2940>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:29.831926 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-d51adc4c-875a-47b9-8286-a50b00ec7bfb tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 200 len: 287 microversion: 2.1 time: 0.033667 Aug 24 05:56:29.832506 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 550/1148] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 05:56:29 2022] GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:30.844631 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-fea1b92a-9220-4426-9d11-af66b42114e8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c3e33a0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:30.874874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-fea1b92a-9220-4426-9d11-af66b42114e8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 200 len: 288 microversion: 2.1 time: 0.034470 Aug 24 05:56:30.875439 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 599/1149] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 05:56:30 2022] GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:30.887588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-73eeed26-3628-43ea-9fe8-d7da1844c9a8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91cd503a0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:30.945430 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-73eeed26-3628-43ea-9fe8-d7da1844c9a8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 202 len: 0 microversion: 2.1 time: 0.062113 Aug 24 05:56:30.946120 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 551/1150] 10.222.0.73 () {58 vars in 1254 bytes} [Wed Aug 24 05:56:30 2022] DELETE /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:56:30.954422 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ad3a78a9-ea55-4de2-9249-96c018af7d9e tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c3e34c0>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:30.983679 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ad3a78a9-ea55-4de2-9249-96c018af7d9e tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 200 len: 287 microversion: 2.1 time: 0.033119 Aug 24 05:56:30.984248 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 600/1151] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 05:56:30 2022] GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:31.993711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=22 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:31.994470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:31.998725 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-52581010-dc8a-44df-92f2-f7fa646f89f8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91ccd9f70>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:32.024502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-52581010-dc8a-44df-92f2-f7fa646f89f8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] HTTP exception thrown: Snapshot 2be37586-6602-45c5-9b7e-55b054c010ec could not be found. Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-52581010-dc8a-44df-92f2-f7fa646f89f8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Request method failure captured: Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec HTTP/1.1 Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBb2JLYgtJtkKmaRu1YTo9ixBbsV_6SfQD5BlIGbdYh27Fl4IIEcR0HKg7xuAWN2f_QIN5YIg0hA24Y_lkjkrZZLn-wWIRzcFblJaItxXzMuH-rkzCddFxitLy_83AcI2mPlyTRixqMXT7TZo1v4Kjsm29ccSw1rETLwhdDc-sLJW07A Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:56:32.026722 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5d32487a82854812803e77fb483323b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5d32487a82854812803e77fb483323b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: e49c8c61fc974f209a3a05f67e8e5790 Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Snapshot 2be37586-6602-45c5-9b7e-55b054c010ec could not be found. Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '2be37586-6602-45c5-9b7e-55b054c010ec'} Aug 24 05:56:32.028283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2be37586-6602-45c5-9b7e-55b054c010ec could not be found. (HTTP 404) (Request-ID: req-fe68cf63-1e5d-496d-b531-ea4043f8ed5a) Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:32.029261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:56:32.030665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2be37586-6602-45c5-9b7e-55b054c010ec could not be found. Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 05:56:32.032082 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2be37586-6602-45c5-9b7e-55b054c010ec could not be found. Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2be37586-6602-45c5-9b7e-55b054c010ec could not be found. Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-52581010-dc8a-44df-92f2-f7fa646f89f8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Returning 404 to user: Snapshot 2be37586-6602-45c5-9b7e-55b054c010ec could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:32.033531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-52581010-dc8a-44df-92f2-f7fa646f89f8 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec" status: 404 len: 111 microversion: 2.1 time: 0.035511 Aug 24 05:56:32.034509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 552/1152] 10.222.0.73 () {58 vars in 1251 bytes} [Wed Aug 24 05:56:31 2022] GET /compute/v2.1/os-snapshots/2be37586-6602-45c5-9b7e-55b054c010ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:32.034606 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:32.034606 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:56:32.039257 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b4cb5335-75d7-413b-ac04-695728d55ada tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c412b80>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:32.099600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b4cb5335-75d7-413b-ac04-695728d55ada tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190" status: 202 len: 0 microversion: 2.1 time: 0.066426 Aug 24 05:56:32.100169 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 601/1153] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:56:32 2022] DELETE /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:56:32.108675 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bfbf8aac-8d38-4bbf-9c72-d6afd5eafec9 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c242b80>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:32.156693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bfbf8aac-8d38-4bbf-9c72-d6afd5eafec9 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190" status: 200 len: 344 microversion: 2.1 time: 0.052246 Aug 24 05:56:32.157265 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 553/1154] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:56:32 2022] GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:56:33.171224 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-82687ecb-630a-4e12-a4f7-0784b4535678 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c4be940>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:33.199466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-82687ecb-630a-4e12-a4f7-0784b4535678 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] HTTP exception thrown: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-82687ecb-630a-4e12-a4f7-0784b4535678 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Request method failure captured: Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 HTTP/1.1 Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBb2JLYgtJtkKmaRu1YTo9ixBbsV_6SfQD5BlIGbdYh27Fl4IIEcR0HKg7xuAWN2f_QIN5YIg0hA24Y_lkjkrZZLn-wWIRzcFblJaItxXzMuH-rkzCddFxitLy_83AcI2mPlyTRixqMXT7TZo1v4Kjsm29ccSw1rETLwhdDc-sLJW07A Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:56:33.201637 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5d32487a82854812803e77fb483323b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5d32487a82854812803e77fb483323b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: e49c8c61fc974f209a3a05f67e8e5790 Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': 'be9595f2-29c7-423c-a75a-5c2d4c46c190'} Aug 24 05:56:33.203117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. (HTTP 404) (Request-ID: req-25505bab-4ad1-4e4d-880a-738696ad0d91) Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.203941 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:56:33.205328 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:56:33.206924 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-82687ecb-630a-4e12-a4f7-0784b4535678 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Returning 404 to user: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-82687ecb-630a-4e12-a4f7-0784b4535678 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190" status: 404 len: 109 microversion: 2.1 time: 0.036276 Aug 24 05:56:33.208946 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 602/1155] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:56:33 2022] GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:33.219711 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-90bce912-0c18-4cc2-9320-6a5cedc32e3b tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c2690d0>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:33.247482 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-90bce912-0c18-4cc2-9320-6a5cedc32e3b tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] HTTP exception thrown: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-90bce912-0c18-4cc2-9320-6a5cedc32e3b tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Request method failure captured: Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: DELETE /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 HTTP/1.1 Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBb2JLYgtJtkKmaRu1YTo9ixBbsV_6SfQD5BlIGbdYh27Fl4IIEcR0HKg7xuAWN2f_QIN5YIg0hA24Y_lkjkrZZLn-wWIRzcFblJaItxXzMuH-rkzCddFxitLy_83AcI2mPlyTRixqMXT7TZo1v4Kjsm29ccSw1rETLwhdDc-sLJW07A Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:56:33.249464 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5d32487a82854812803e77fb483323b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5d32487a82854812803e77fb483323b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: e49c8c61fc974f209a3a05f67e8e5790 Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': 'be9595f2-29c7-423c-a75a-5c2d4c46c190'} Aug 24 05:56:33.251051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. (HTTP 404) (Request-ID: req-0dd4577e-2d75-42c2-99bf-4a38ce817d42) Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.252067 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 05:56:33.257754 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 05:56:33.259207 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-90bce912-0c18-4cc2-9320-6a5cedc32e3b tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Returning 404 to user: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:33.260588 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-90bce912-0c18-4cc2-9320-6a5cedc32e3b tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190" status: 404 len: 109 microversion: 2.1 time: 0.035691 Aug 24 05:56:33.261551 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 554/1156] 10.222.0.73 () {58 vars in 1248 bytes} [Wed Aug 24 05:56:33 2022] DELETE /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:56:33.261669 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a808958e-1ee5-4c72-9e2a-253096920bc3 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Calling method '.version_select at 0x7fa91c357b80>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:56:33.289043 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-a808958e-1ee5-4c72-9e2a-253096920bc3 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] HTTP exception thrown: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a808958e-1ee5-4c72-9e2a-253096920bc3 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Request method failure captured: Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 HTTP/1.1 Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBb2JLYgtJtkKmaRu1YTo9ixBbsV_6SfQD5BlIGbdYh27Fl4IIEcR0HKg7xuAWN2f_QIN5YIg0hA24Y_lkjkrZZLn-wWIRzcFblJaItxXzMuH-rkzCddFxitLy_83AcI2mPlyTRixqMXT7TZo1v4Kjsm29ccSw1rETLwhdDc-sLJW07A Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 05:56:33.291546 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_5d32487a82854812803e77fb483323b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/5d32487a82854812803e77fb483323b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/5d32487a82854812803e77fb483323b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 5d32487a82854812803e77fb483323b9 Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1271825891 Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: e49c8c61fc974f209a3a05f67e8e5790 Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1271825891-project Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': 'be9595f2-29c7-423c-a75a-5c2d4c46c190'} Aug 24 05:56:33.293129 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. (HTTP 404) (Request-ID: req-37cba453-f597-42d7-8792-a8b8662dd5b8) Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.294051 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:56:33.295191 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:56:33.296329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-a808958e-1ee5-4c72-9e2a-253096920bc3 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] Returning 404 to user: Volume be9595f2-29c7-423c-a75a-5c2d4c46c190 could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-a808958e-1ee5-4c72-9e2a-253096920bc3 tempest-VolumesSnapshotsTestJSON-1271825891 tempest-VolumesSnapshotsTestJSON-1271825891-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190" status: 404 len: 109 microversion: 2.1 time: 0.037594 Aug 24 05:56:33.297466 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 603/1157] 10.222.0.73 () {58 vars in 1245 bytes} [Wed Aug 24 05:56:33 2022] GET /compute/v2.1/os-volumes/be9595f2-29c7-423c-a75a-5c2d4c46c190 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:24.378732 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:57:24.379312 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 05:57:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:57:26.130627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:26.131306 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:26.137191 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:26.137709 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:26.138144 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:26.138833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:26.139285 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:26.139710 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:26.163834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Going to try to terminate instance {{(pid=127193) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:57:26.241006 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-eb8eb1ef-92d7-4085-a498-9ca0bcb8ec9a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 204 len: 0 microversion: 2.1 time: 0.115484 Aug 24 05:57:26.241452 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 555/1158] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 05:57:26 2022] DELETE /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:57:26.252964 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:26.253590 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:26.259755 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:26.260228 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:26.260659 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:26.261353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:26.261850 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:26.262274 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:26.391386 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:26.399095 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-82992f85-dc3e-4d58-841f-fe839018df3b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1577 microversion: 2.1 time: 0.153343 Aug 24 05:57:26.400187 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 604/1159] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:26 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:27.421786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:27.422470 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:27.428704 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:27.429086 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:27.429556 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:27.430256 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:27.430702 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:27.431552 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:27.570719 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:27.579165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c9c2522d-b356-4169-8a58-455ec8b8684f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1577 microversion: 2.1 time: 0.161646 Aug 24 05:57:27.579729 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 556/1160] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:27 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:28.601317 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:28.603161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:28.609812 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:28.610305 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:28.610743 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:28.611445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:28.611901 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:28.612329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:28.694607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:28.708282 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d2762b7a-8cf8-4ab9-95a3-84073b6e9e27 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1509 microversion: 2.1 time: 0.110910 Aug 24 05:57:28.709885 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 605/1161] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:28 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1509 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:29.197734 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-79fafab0-bb8e-4f13-80fb-6d6f3397d136 req-4461bd76-2b67-40e2-ab3f-5d1d1f7a4700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4556e949-3ebd-4453-9406-907389fb9d6a", "name": "network-vif-deleted", "tag": "4eac820b-0992-4e52-954f-fdfb91542152"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:29.218415 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-79fafab0-bb8e-4f13-80fb-6d6f3397d136 req-4461bd76-2b67-40e2-ab3f-5d1d1f7a4700 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:29.219125 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-79fafab0-bb8e-4f13-80fb-6d6f3397d136 req-4461bd76-2b67-40e2-ab3f-5d1d1f7a4700 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:29.219914 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-79fafab0-bb8e-4f13-80fb-6d6f3397d136 req-4461bd76-2b67-40e2-ab3f-5d1d1f7a4700 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:29.234627 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-79fafab0-bb8e-4f13-80fb-6d6f3397d136 req-4461bd76-2b67-40e2-ab3f-5d1d1f7a4700 service nova] Creating event network-vif-deleted:4eac820b-0992-4e52-954f-fdfb91542152 for instance 4556e949-3ebd-4453-9406-907389fb9d6a on hv-cinder-85426 Aug 24 05:57:29.241045 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-79fafab0-bb8e-4f13-80fb-6d6f3397d136 req-4461bd76-2b67-40e2-ab3f-5d1d1f7a4700 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314532 Aug 24 05:57:29.241999 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 557/1162] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:57:29.730345 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:29.731692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:29.740178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:29.741002 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:29.741647 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:29.742830 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:29.744607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:29.745229 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:29.781855 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:29.782696 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:29.783561 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:29.784432 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.objects.instance [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lazy-loading 'fault' on Instance uuid 4556e949-3ebd-4453-9406-907389fb9d6a {{(pid=127194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:57:29.845518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:29.853852 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-3e609af2-7b15-4c3e-a59f-f657d5d4ca3d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 200 len: 1184 microversion: 2.1 time: 0.127576 Aug 24 05:57:29.854132 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 606/1163] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:29 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 1184 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:30.875259 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:30.875990 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:30.882143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:30.882617 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:30.883052 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:30.883770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:30.884855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:30.885279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:30.898267 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] HTTP exception thrown: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Request method failure captured: Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a HTTP/1.1 Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBb0uTnNt08fTbeeJ_sCI8cAv43Byd61smmsZPE7zk79ymndz4dDY5PU-d5tsUuabo-Qe77JpflDcVzmIf9IORl0sUDOepG8w8hbXLzDSBA22PIqwqao7297eCoEEk4mP0e_nbaIKitddbCD-6S21oLG0ptSWSTSPd6fy34EE5R3fkkk Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 05:57:30.899952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-TestVolumeBootPattern-970304747 Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-TestVolumeBootPattern-970304747-project Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 389ae44e6cfd4f5fbe56063e5b0ae787 Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-TestVolumeBootPattern-970304747-project Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 05:57:30.901664 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '4556e949-3ebd-4453-9406-907389fb9d6a'} Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:57:30.902665 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 05:57:30.904232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 05:57:30.905694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Returning 404 to user: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:57:30.905694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-30227fca-5255-4c5c-bd84-d79bc0f524c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 404 len: 111 microversion: 2.1 time: 0.030692 Aug 24 05:57:30.905694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 558/1164] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:30 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:57:30.996273 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-755772261", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1214081369", "security_groups": [{"name": "tempest-secgroup-smoke-1514284810"}], "block_device_mapping_v2": [{"uuid": "66dc55f1-bbba-4a7d-8008-1e26a62c8dfd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a20f248-f558-4ed2-854a-73b79351018a"}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:31.112325 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] validate_networks() for [('3a20f248-f558-4ed2-854a-73b79351018a', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:57:31.611445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:57:31.612448 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:57:31.613843 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:57:31.613843 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:57:31.613843 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:57:31.624178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:31.624738 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:31.625186 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:31.626057 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:31.626517 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:31.627024 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:31.648720 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:57:31.653281 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for user 389ae44e6cfd4f5fbe56063e5b0ae787 and project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:57:31.721971 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:57:31.723917 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66dc55f1-bbba-4a7d-8008-1e26a62c8dfd',volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:57:31.854418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d8da9c89-4ff4-40e2-8cfb-3f51c34a191b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.862428 Aug 24 05:57:31.855070 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 607/1165] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:57:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:57:31.866087 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-756e5c04-c6ee-4921-9704-0c548d6cb90b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:31.866705 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-756e5c04-c6ee-4921-9704-0c548d6cb90b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:31.923107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-756e5c04-c6ee-4921-9704-0c548d6cb90b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:31.930224 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-756e5c04-c6ee-4921-9704-0c548d6cb90b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1094 microversion: 2.1 time: 0.067897 Aug 24 05:57:31.930804 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 559/1166] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:31 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:57:32.952935 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-bf34a250-95a8-4996-b7ca-69350d3204d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:32.954155 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-bf34a250-95a8-4996-b7ca-69350d3204d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:33.008267 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-bf34a250-95a8-4996-b7ca-69350d3204d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:33.015786 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-bf34a250-95a8-4996-b7ca-69350d3204d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1094 microversion: 2.1 time: 0.067678 Aug 24 05:57:33.016337 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 608/1167] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:32 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:34.036177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-56df610b-1432-44d3-ad2a-2616dd7e7cc4 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:34.037100 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-56df610b-1432-44d3-ad2a-2616dd7e7cc4 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:34.095017 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-56df610b-1432-44d3-ad2a-2616dd7e7cc4 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:34.102161 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-56df610b-1432-44d3-ad2a-2616dd7e7cc4 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1094 microversion: 2.1 time: 0.070154 Aug 24 05:57:34.102934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 560/1168] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:34 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:35.123323 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-d84faa4d-01c2-42b4-930c-af5ca412728d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:35.123965 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-d84faa4d-01c2-42b4-930c-af5ca412728d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:35.179541 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-d84faa4d-01c2-42b4-930c-af5ca412728d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:35.186953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-d84faa4d-01c2-42b4-930c-af5ca412728d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1094 microversion: 2.1 time: 0.067413 Aug 24 05:57:35.187726 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 609/1169] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:35 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:36.207899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:36.208576 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:36.216851 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:36.217326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:36.217785 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:36.218473 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:36.218919 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:36.219335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:36.279071 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:36.286612 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-04b22973-46a2-4d14-b529-78874e578a63 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1144 microversion: 2.1 time: 0.082551 Aug 24 05:57:36.287166 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 561/1170] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:36 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:37.307315 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:37.307934 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:37.314549 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:37.315042 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:37.315480 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:37.316190 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:37.316643 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:37.317071 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:37.382419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:37.390093 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f033dce6-b94e-442f-88be-62fe5104586b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1210 microversion: 2.1 time: 0.087282 Aug 24 05:57:37.390662 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 610/1171] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:37 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:38.411523 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:38.412137 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:38.419469 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:38.419958 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:38.420390 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:38.421077 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:38.421526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:38.421976 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:38.483099 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:38.490752 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-bee69600-ef26-426f-b49b-f7d6fe1bd6b1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1210 microversion: 2.1 time: 0.083155 Aug 24 05:57:38.491313 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 562/1172] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:38 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:39.511357 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:39.511958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:39.518267 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:39.518741 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:39.519170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:39.519847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:39.520295 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:39.520710 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:39.582515 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:39.590414 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-13d73b6c-eeec-4990-b92e-765357f57284 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1210 microversion: 2.1 time: 0.083052 Aug 24 05:57:39.590976 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 611/1173] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:39 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:40.611072 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:40.612073 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:40.619172 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:40.619786 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:40.620333 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:40.621113 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:40.621800 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:40.622477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:40.831492 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:40.839687 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-e22c275b-3350-440b-8e89-34ab45458c9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.232725 Aug 24 05:57:40.840284 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 563/1174] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:40 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:41.056809 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-14771cef-2af1-492b-b7fc-153fb0bd89f7 req-1379a479-9b79-4a7e-a812-497e4dbb5e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500750aa-c8f0-4325-bab4-2585d3b9f567", "tag": "f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:41.069537 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-14771cef-2af1-492b-b7fc-153fb0bd89f7 req-1379a479-9b79-4a7e-a812-497e4dbb5e7e service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:41.070451 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-14771cef-2af1-492b-b7fc-153fb0bd89f7 req-1379a479-9b79-4a7e-a812-497e4dbb5e7e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:41.071125 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-14771cef-2af1-492b-b7fc-153fb0bd89f7 req-1379a479-9b79-4a7e-a812-497e4dbb5e7e service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:41.082958 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-14771cef-2af1-492b-b7fc-153fb0bd89f7 req-1379a479-9b79-4a7e-a812-497e4dbb5e7e service nova] Creating event network-changed:f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98 for instance 500750aa-c8f0-4325-bab4-2585d3b9f567 on hv-cinder-85426 Aug 24 05:57:41.088543 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-14771cef-2af1-492b-b7fc-153fb0bd89f7 req-1379a479-9b79-4a7e-a812-497e4dbb5e7e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036121 Aug 24 05:57:41.089117 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 612/1175] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:57:41.863321 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:41.863972 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:41.871702 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:41.872182 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:41.873225 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:41.873973 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:41.874428 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:41.874899 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:42.088862 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:42.096573 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-361b72f0-fc3d-4a30-8431-4f130b27eabe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.237207 Aug 24 05:57:42.097135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 564/1176] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:41 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:43.114768 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:43.120445 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:43.121136 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:43.127420 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:43.127887 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:43.128314 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:43.128989 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:43.129433 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:43.129884 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:43.258378 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:43.266130 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e6ff3f43-4b11-492b-97ce-790703a1320e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.152313 Aug 24 05:57:43.266692 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 613/1177] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:43 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:44.286590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:44.287231 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:44.289653 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=4 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:44.295368 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:44.295848 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:44.296283 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:44.296975 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:44.297427 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:44.297884 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:44.431126 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:44.439928 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-234cd4bf-1011-4e98-8f1b-17dda395a85b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.157203 Aug 24 05:57:44.440483 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 565/1178] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:44 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:45.460015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:45.460626 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:45.462890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=10 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:45.469085 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:45.469583 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:45.470022 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:45.470721 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:45.471170 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:45.471600 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:45.605586 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:45.613829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-6ed4c50e-2bd3-425a-880d-a19386bc2cc6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.157495 Aug 24 05:57:45.614392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 614/1179] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:45 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:46.099683 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:57:46.100278 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 05:57:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:57:46.635247 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:46.635853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:46.642577 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:46.643088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:46.643522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:46.644222 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:46.647107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:46.647107 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:46.777908 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:46.785876 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-26fcaffe-e133-42c5-a3a1-d84257f9472d tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.154548 Aug 24 05:57:46.786460 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 566/1180] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:46 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:47.807355 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:47.808027 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:47.814881 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:47.815392 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:47.815827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:47.816524 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:47.817389 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:47.817522 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:47.951131 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:47.958882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-2e56fdd0-a6b1-456b-96d6-a1ab0fa092fe tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.155360 Aug 24 05:57:47.959504 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 615/1181] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:47 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:48.979589 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:48.980214 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:48.986808 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:48.987276 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:48.987701 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:48.988378 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:48.988821 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:48.989237 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:49.120075 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:49.127724 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3e182756-1891-4218-81ec-0bda99ef482a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.152023 Aug 24 05:57:49.128272 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 567/1182] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:48 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:50.149581 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:50.150481 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:50.157607 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:50.158089 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:50.158562 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:50.159245 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:50.159734 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:50.160144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:50.301446 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:50.309171 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-f3661133-1f90-4c66-8ab4-4f630febc0d3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.164624 Aug 24 05:57:50.309773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 616/1183] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:50 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:51.329867 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:51.330562 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:51.336925 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:51.337395 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:51.337849 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:51.338531 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:51.338990 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:51.339411 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:51.477354 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:51.485952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-00bf01ff-ac71-4ad7-a6f7-86f3f91300c6 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.159969 Aug 24 05:57:51.486522 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 568/1184] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:51 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:52.127374 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-bc7a1355-1776-4daf-b26d-2fd7a3a848ca req-1218950a-14d3-4a3d-b3cb-86aec1db1b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500750aa-c8f0-4325-bab4-2585d3b9f567", "name": "network-vif-plugged", "status": "completed", "tag": "f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:52.137604 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-bc7a1355-1776-4daf-b26d-2fd7a3a848ca req-1218950a-14d3-4a3d-b3cb-86aec1db1b6a service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:52.138078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-bc7a1355-1776-4daf-b26d-2fd7a3a848ca req-1218950a-14d3-4a3d-b3cb-86aec1db1b6a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:52.138505 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-bc7a1355-1776-4daf-b26d-2fd7a3a848ca req-1218950a-14d3-4a3d-b3cb-86aec1db1b6a service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:52.149385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-bc7a1355-1776-4daf-b26d-2fd7a3a848ca req-1218950a-14d3-4a3d-b3cb-86aec1db1b6a service nova] Creating event network-vif-plugged:f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98 for instance 500750aa-c8f0-4325-bab4-2585d3b9f567 on hv-cinder-85426 Aug 24 05:57:52.155242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-bc7a1355-1776-4daf-b26d-2fd7a3a848ca req-1218950a-14d3-4a3d-b3cb-86aec1db1b6a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154855 Aug 24 05:57:52.155839 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 617/1185] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:57:52.507295 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:52.507921 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:52.515029 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:52.515509 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:52.515943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:52.516641 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:52.517089 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:52.517508 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:52.653242 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:52.661377 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-1eb8d6c4-1bea-471d-b195-6267b1ba34d1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.158080 Aug 24 05:57:52.662263 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 569/1186] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:52 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:57:53.741078 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:53.741815 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:53.748372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:53.748847 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:53.749275 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:53.749993 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:53.750443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:53.750865 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:53.889088 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:53.898408 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-cd019c3a-15b1-4cd2-806e-a518d72c2d5a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1266 microversion: 2.1 time: 0.161918 Aug 24 05:57:53.905703 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 618/1187] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:53 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:54.918429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:54.919051 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:54.925662 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:54.926150 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:54.926590 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:54.927286 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:54.927744 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:54.928168 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:55.058586 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:55.066261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-4ba00b16-812e-430d-a6e8-25feb0af2f2c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1452 microversion: 2.1 time: 0.151620 Aug 24 05:57:55.066820 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 570/1188] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:54 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:55.086715 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:57:55.087329 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:57:55.094610 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:55.095087 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:55.095520 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:55.096215 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:55.096666 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:55.097083 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:55.225285 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:57:55.233138 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-dd58d957-845c-4bea-bd28-cbee209ee146 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1452 microversion: 2.1 time: 0.150033 Aug 24 05:57:55.233736 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 619/1189] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:57:55 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:57:56.765770 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-4c6d3d64-3c3c-474e-8db4-3f8d89442343 req-51ba5e29-85f7-4a2c-9f00-1f76b46f2dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500750aa-c8f0-4325-bab4-2585d3b9f567", "tag": "f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:57:56.771151 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:56.777530 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4c6d3d64-3c3c-474e-8db4-3f8d89442343 req-51ba5e29-85f7-4a2c-9f00-1f76b46f2dd9 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:57:56.778033 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4c6d3d64-3c3c-474e-8db4-3f8d89442343 req-51ba5e29-85f7-4a2c-9f00-1f76b46f2dd9 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:57:56.778502 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-4c6d3d64-3c3c-474e-8db4-3f8d89442343 req-51ba5e29-85f7-4a2c-9f00-1f76b46f2dd9 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:57:56.782792 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:57:56.793927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-4c6d3d64-3c3c-474e-8db4-3f8d89442343 req-51ba5e29-85f7-4a2c-9f00-1f76b46f2dd9 service nova] Creating event network-changed:f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98 for instance 500750aa-c8f0-4325-bab4-2585d3b9f567 on hv-cinder-85426 Aug 24 05:57:56.800988 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-4c6d3d64-3c3c-474e-8db4-3f8d89442343 req-51ba5e29-85f7-4a2c-9f00-1f76b46f2dd9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039469 Aug 24 05:57:56.801791 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 571/1190] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:59:20.376595 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:59:20.377188 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Wed Aug 24 05:59:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:59:43.186233 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.187002 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=74 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.190966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-980293127", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1214081369", "security_groups": [{"name": "tempest-secgroup-smoke-1514284810"}], "block_device_mapping_v2": [{"uuid": "f87ce77f-0dd8-4dde-afa6-30466d8aeffe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3a20f248-f558-4ed2-854a-73b79351018a"}]}} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:43.303953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.network.neutron [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] validate_networks() for [('3a20f248-f558-4ed2-854a-73b79351018a', None, None, None, None, None)] {{(pid=127194) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:59:43.662375 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Flavor limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:59:43.662905 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Image limits 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:59:43.663382 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Flavor pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:59:43.663781 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Image pref 0:0:0 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:59:43.664181 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.virt.hardware [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:59:43.672868 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:43.673346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:43.673819 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:43.674542 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:43.674993 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:43.675419 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:43.692456 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:59:43.696324 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.quota [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Getting quotas for user 389ae44e6cfd4f5fbe56063e5b0ae787 and project 76656ddf3c744ba1a32cfaa37e278ef2. Resources: {'cores', 'instances', 'ram'} {{(pid=127194) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:59:43.753238 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Going to run 1 instances... {{(pid=127194) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:59:43.756021 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f87ce77f-0dd8-4dde-afa6-30466d8aeffe',volume_size=None,volume_type=None)] {{(pid=127194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:59:43.883775 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5de9ab81-cf86-4d8b-a691-ebc84f99745a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699154 Aug 24 05:59:43.884418 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 620/1191] 10.222.0.73 () {60 vars in 1147 bytes} [Wed Aug 24 05:59:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:59:43.893934 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR oslo.messaging._drivers.impl_rabbit [-] [759f9a55-72f6-4b01-bf5b-0a5bca4d7788] AMQP server on 10.222.0.73:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 05:59:43.895137 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=1 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:43.899960 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-55705a06-7203-4ef2-b74b-3056514b1592 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:43.900674 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-55705a06-7203-4ef2-b74b-3056514b1592 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:43.956343 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-55705a06-7203-4ef2-b74b-3056514b1592 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:43.964059 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-55705a06-7203-4ef2-b74b-3056514b1592 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1094 microversion: 2.1 time: 0.072318 Aug 24 05:59:43.964614 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 572/1192] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:43 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:44.985363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:44.985983 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:44.991966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:44.992443 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:44.992989 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:44.993709 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:44.994160 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:44.994580 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:45.060424 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:45.069611 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-eedce476-e479-499f-8171-bf925b9232e1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1192 microversion: 2.1 time: 0.089096 Aug 24 05:59:45.070183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 621/1193] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:44 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:46.090946 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:46.091779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:46.103261 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] [759f9a55-72f6-4b01-bf5b-0a5bca4d7788] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55874. Aug 24 05:59:46.108514 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:46.109006 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:46.109447 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:46.110177 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:46.110631 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:46.111058 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:46.312270 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:46.319978 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c0406298-e6ce-41b9-bdc6-9a62a140ef9c tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.232992 Aug 24 05:59:46.320538 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 573/1194] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:46 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:46.538966 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [req-8cd776ad-6e5a-4fe5-8a49-1d8e95b18b9b req-46f5a3f3-4f8c-4af2-b8c3-d5808c4b0d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39996254-09aa-445c-b1bd-9c9bebb3f33a", "tag": "8d211611-cb20-4971-b3c3-ed93213d11ac"}]} {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:46.551385 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-8cd776ad-6e5a-4fe5-8a49-1d8e95b18b9b req-46f5a3f3-4f8c-4af2-b8c3-d5808c4b0d55 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:46.552861 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-8cd776ad-6e5a-4fe5-8a49-1d8e95b18b9b req-46f5a3f3-4f8c-4af2-b8c3-d5808c4b0d55 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:46.553302 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [req-8cd776ad-6e5a-4fe5-8a49-1d8e95b18b9b req-46f5a3f3-4f8c-4af2-b8c3-d5808c4b0d55 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:46.564557 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.compute.server_external_events [req-8cd776ad-6e5a-4fe5-8a49-1d8e95b18b9b req-46f5a3f3-4f8c-4af2-b8c3-d5808c4b0d55 service nova] Creating event network-changed:8d211611-cb20-4971-b3c3-ed93213d11ac for instance 39996254-09aa-445c-b1bd-9c9bebb3f33a on hv-cinder-85426 Aug 24 05:59:46.570274 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [req-8cd776ad-6e5a-4fe5-8a49-1d8e95b18b9b req-46f5a3f3-4f8c-4af2-b8c3-d5808c4b0d55 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035016 Aug 24 05:59:46.571039 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 622/1195] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:59:47.342714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:47.342714 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:47.349365 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:47.349874 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:47.350491 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:47.351185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:47.351631 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:47.352047 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:47.585002 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:47.592635 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-8564b4f1-9b2e-422b-af84-f3212aaa435e tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.254461 Aug 24 05:59:47.597331 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 574/1196] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:47 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:48.615518 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:48.616214 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:48.622774 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:48.623250 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:48.623682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:48.624372 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:48.624822 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:48.625242 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:48.753773 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:48.761341 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ab4ba5bd-2c03-460d-bb96-d47186620217 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.150846 Aug 24 05:59:48.761932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 623/1197] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:48 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:49.782281 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:49.782871 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:49.789234 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:49.789752 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:49.790184 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:49.790870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:49.791319 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:49.791739 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:49.927626 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:49.935251 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-460e2748-ba63-4f81-8dde-91f2a034cfa3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.156917 Aug 24 05:59:49.935814 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 575/1198] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:49 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:50.956363 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:50.956962 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:50.963343 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:50.963823 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:50.964256 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:50.964953 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:50.965406 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:50.965893 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:51.094740 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:51.102752 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-9ad14056-fc6c-4773-9ab4-2f60aba4f539 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.150303 Aug 24 05:59:51.103300 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 624/1199] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:50 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:52.124080 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:52.124702 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:52.131736 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:52.132212 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:52.132643 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:52.133334 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:52.133822 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:52.134244 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:52.260519 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:52.268463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3cc3aa45-6197-4f05-a278-a8767037ba4a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.148247 Aug 24 05:59:52.269038 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 576/1200] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:52 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:53.288904 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:53.289512 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:53.295453 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:53.295932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:53.295932 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:53.297033 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:53.297484 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:53.297927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:53.429297 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:53.436897 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-1661be67-1a8f-4613-8bc3-7c797797a769 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.151993 Aug 24 05:59:53.437461 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 625/1201] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:53 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:54.458568 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:54.459192 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:54.461513 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell0:SELECT=2 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:54.466841 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:54.467322 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:54.467760 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:54.468468 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:54.468921 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:54.469349 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:54.604135 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:54.612143 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-c9f90808-2cea-4619-bb2a-dc8f72e309be tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.158106 Aug 24 05:59:54.612716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 577/1202] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:54 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:55.632927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:55.633526 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:55.635495 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=2 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:55.636145 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell0:SELECT=6 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:59:55.642417 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:55.642891 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:55.643323 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:55.644004 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:55.644452 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:55.646068 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:55.777225 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:55.784874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-800dcbb6-6d23-4722-a377-7ffd54f6896b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.155860 Aug 24 05:59:55.786070 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 626/1203] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:55 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:56.565847 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-0baa84c9-fe28-42dc-9a83-74b366fa4b52 req-ac0391d9-262f-4f4c-9542-c7f9ae58a5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39996254-09aa-445c-b1bd-9c9bebb3f33a", "name": "network-vif-plugged", "status": "completed", "tag": "8d211611-cb20-4971-b3c3-ed93213d11ac"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:59:56.577233 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-0baa84c9-fe28-42dc-9a83-74b366fa4b52 req-ac0391d9-262f-4f4c-9542-c7f9ae58a5a7 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:56.577753 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-0baa84c9-fe28-42dc-9a83-74b366fa4b52 req-ac0391d9-262f-4f4c-9542-c7f9ae58a5a7 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:56.578185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-0baa84c9-fe28-42dc-9a83-74b366fa4b52 req-ac0391d9-262f-4f4c-9542-c7f9ae58a5a7 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:56.589663 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-0baa84c9-fe28-42dc-9a83-74b366fa4b52 req-ac0391d9-262f-4f4c-9542-c7f9ae58a5a7 service nova] Creating event network-vif-plugged:8d211611-cb20-4971-b3c3-ed93213d11ac for instance 39996254-09aa-445c-b1bd-9c9bebb3f33a on hv-cinder-85426 Aug 24 05:59:56.594853 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-0baa84c9-fe28-42dc-9a83-74b366fa4b52 req-ac0391d9-262f-4f4c-9542-c7f9ae58a5a7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032755 Aug 24 05:59:56.595476 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 578/1204] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 05:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:59:56.806735 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:56.807283 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:56.813874 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:56.814353 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:56.814784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:56.815475 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:56.815927 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:56.816356 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:56.951035 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:56.958784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-27f257ec-9d4c-4fb0-900d-6258b750d5e9 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1266 microversion: 2.1 time: 0.156046 Aug 24 05:59:56.959348 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 627/1205] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:56 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:59:57.982273 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:57.982967 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:57.989878 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:57.990357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:57.990790 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:57.991477 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:57.991927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:57.992367 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:58.123986 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:58.132255 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-f74ecb21-e2d9-423b-a2f1-8b4774ed9c81 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1452 microversion: 2.1 time: 0.154746 Aug 24 05:59:58.132818 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 579/1206] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:57 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:59:58.151997 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:59:58.152609 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:59:58.159502 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:58.159979 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:58.160415 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:58.161105 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:59:58.161582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:59:58.162007 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:59:58.290718 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:59:58.298582 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-b20b9f09-fe2d-4d42-a074-39abadaefd4b tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1452 microversion: 2.1 time: 0.150357 Aug 24 05:59:58.299156 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 628/1207] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 05:59:58 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:00:00.181527 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-ecc1a8d4-6c9d-40dc-a36d-2e88664891cb req-ee5b9d67-a903-40dd-9918-cb8f7bf86a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39996254-09aa-445c-b1bd-9c9bebb3f33a", "tag": "8d211611-cb20-4971-b3c3-ed93213d11ac"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:00:00.191456 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-ecc1a8d4-6c9d-40dc-a36d-2e88664891cb req-ee5b9d67-a903-40dd-9918-cb8f7bf86a64 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:00:00.192429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-ecc1a8d4-6c9d-40dc-a36d-2e88664891cb req-ee5b9d67-a903-40dd-9918-cb8f7bf86a64 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:00:00.192859 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-ecc1a8d4-6c9d-40dc-a36d-2e88664891cb req-ee5b9d67-a903-40dd-9918-cb8f7bf86a64 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:00:00.204756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-ecc1a8d4-6c9d-40dc-a36d-2e88664891cb req-ee5b9d67-a903-40dd-9918-cb8f7bf86a64 service nova] Creating event network-changed:8d211611-cb20-4971-b3c3-ed93213d11ac for instance 39996254-09aa-445c-b1bd-9c9bebb3f33a on hv-cinder-85426 Aug 24 06:00:00.210460 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-ecc1a8d4-6c9d-40dc-a36d-2e88664891cb req-ee5b9d67-a903-40dd-9918-cb8f7bf86a64 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164685 Aug 24 06:00:00.211052 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 580/1208] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 06:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:00:44.387852 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:00:44.388463 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 06:00:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:01:06.108180 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:01:06.109068 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 06:01:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:01:30.077016 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:30.077821 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG dbcounter [-] [127194] Writing DB stats nova_cell1:SELECT=46 {{(pid=127194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:30.081209 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_api:SELECT=20 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:30.082216 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:30.082693 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG dbcounter [-] [127193] Writing DB stats nova_cell1:SELECT=41 {{(pid=127193) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:01:30.082840 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:30.087381 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-39fe0875-c732-4cc0-b54a-a555192bcae0 req-f619b9b6-b9bc-4b0b-84ba-474421389723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39996254-09aa-445c-b1bd-9c9bebb3f33a", "tag": "8d211611-cb20-4971-b3c3-ed93213d11ac"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:30.090711 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.091198 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.091632 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.092701 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.093162 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.093602 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.100537 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-39fe0875-c732-4cc0-b54a-a555192bcae0 req-f619b9b6-b9bc-4b0b-84ba-474421389723 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.101316 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-39fe0875-c732-4cc0-b54a-a555192bcae0 req-f619b9b6-b9bc-4b0b-84ba-474421389723 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.102016 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-39fe0875-c732-4cc0-b54a-a555192bcae0 req-f619b9b6-b9bc-4b0b-84ba-474421389723 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.115658 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-39fe0875-c732-4cc0-b54a-a555192bcae0 req-f619b9b6-b9bc-4b0b-84ba-474421389723 service nova] Creating event network-changed:8d211611-cb20-4971-b3c3-ed93213d11ac for instance 39996254-09aa-445c-b1bd-9c9bebb3f33a on hv-cinder-85426 Aug 24 06:01:30.119346 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:01:30.121253 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-39fe0875-c732-4cc0-b54a-a555192bcae0 req-f619b9b6-b9bc-4b0b-84ba-474421389723 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042136 Aug 24 06:01:30.123090 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 581/1209] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:30.203398 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-42297ea4-5f01-40f6-8823-11c7ded8a3c1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "DELETE /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 204 len: 0 microversion: 2.1 time: 0.127763 Aug 24 06:01:30.205827 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 629/1210] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 06:01:30 2022] DELETE /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:01:30.214309 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:30.215128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:30.221465 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.222185 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.222796 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.223498 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:30.224118 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:30.224547 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:30.411916 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:30.419943 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-5624f1f8-b09c-44cd-92a1-28b19ee05dbd tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1577 microversion: 2.1 time: 0.210710 Aug 24 06:01:30.420526 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 582/1211] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:30 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:31.442141 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:31.442857 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:31.449367 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:31.449882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:31.450323 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:31.451018 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:31.451471 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:31.451892 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:31.637136 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:31.644882 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0b311fd5-e010-4eb2-9029-2b63bea4adb5 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1577 microversion: 2.1 time: 0.207123 Aug 24 06:01:31.645370 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 630/1212] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:31 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:01:32.474358 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-8305a3c8-7ad0-4b98-9a44-523be3d45ccd req-97d4d44a-b57c-45db-997a-926cee409d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39996254-09aa-445c-b1bd-9c9bebb3f33a", "name": "network-vif-deleted", "tag": "8d211611-cb20-4971-b3c3-ed93213d11ac"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:32.484883 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8305a3c8-7ad0-4b98-9a44-523be3d45ccd req-97d4d44a-b57c-45db-997a-926cee409d28 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:32.485419 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8305a3c8-7ad0-4b98-9a44-523be3d45ccd req-97d4d44a-b57c-45db-997a-926cee409d28 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:32.486104 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-8305a3c8-7ad0-4b98-9a44-523be3d45ccd req-97d4d44a-b57c-45db-997a-926cee409d28 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:32.498637 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-8305a3c8-7ad0-4b98-9a44-523be3d45ccd req-97d4d44a-b57c-45db-997a-926cee409d28 service nova] Creating event network-vif-deleted:8d211611-cb20-4971-b3c3-ed93213d11ac for instance 39996254-09aa-445c-b1bd-9c9bebb3f33a on hv-cinder-85426 Aug 24 06:01:32.504266 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-8305a3c8-7ad0-4b98-9a44-523be3d45ccd req-97d4d44a-b57c-45db-997a-926cee409d28 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Aug 24 06:01:32.504856 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 583/1213] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:32.668186 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:32.668784 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:32.674725 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:32.675146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:32.675573 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:32.676251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:32.676722 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:32.677113 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:32.739310 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:32.747286 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-ce3c2bb8-7096-4058-aa8c-29b3972a3d6f tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 200 len: 1225 microversion: 2.1 time: 0.084758 Aug 24 06:01:32.747863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 631/1214] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:32 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:33.769035 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:33.769776 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 39996254-09aa-445c-b1bd-9c9bebb3f33a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:33.775869 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:33.776353 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:33.776831 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:33.777521 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:33.778004 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:33.778429 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:33.791931 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] HTTP exception thrown: Instance 39996254-09aa-445c-b1bd-9c9bebb3f33a could not be found. Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Request method failure captured: Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a HTTP/1.1 Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBb0uTnNt08fTbeeJ_sCI8cAv43Byd61smmsZPE7zk79ymndz4dDY5PU-d5tsUuabo-Qe77JpflDcVzmIf9IORl0sUDOepG8w8hbXLzDSBA22PIqwqao7297eCoEEk4mP0e_nbaIKitddbCD-6S21oLG0ptSWSTSPd6fy34EE5R3fkkk Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 06:01:33.793524 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 389ae44e6cfd4f5fbe56063e5b0ae787 Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 39996254-09aa-445c-b1bd-9c9bebb3f33a could not be found. Aug 24 06:01:33.795298 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '39996254-09aa-445c-b1bd-9c9bebb3f33a'} Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39996254-09aa-445c-b1bd-9c9bebb3f33a could not be found. Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:01:33.796291 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39996254-09aa-445c-b1bd-9c9bebb3f33a could not be found. Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39996254-09aa-445c-b1bd-9c9bebb3f33a could not be found. Aug 24 06:01:33.797966 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:33.799583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Returning 404 to user: Instance 39996254-09aa-445c-b1bd-9c9bebb3f33a could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:01:33.799583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-cdc633c5-4263-4eac-8c4e-81a82c09c3aa tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a" status: 404 len: 111 microversion: 2.1 time: 0.030533 Aug 24 06:01:33.799583 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 584/1215] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:33 2022] GET /compute/v2.1/servers/39996254-09aa-445c-b1bd-9c9bebb3f33a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:01:36.850568 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:36.851060 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:36.858651 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:36.859263 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:36.859386 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-49f19650-35d6-45b2-bb95-b5dd57699db4 req-9ca516ed-8663-4b56-ad54-b1d9f79cfbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500750aa-c8f0-4325-bab4-2585d3b9f567", "tag": "f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:36.859804 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:36.860647 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:36.861178 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:36.861742 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:36.868855 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49f19650-35d6-45b2-bb95-b5dd57699db4 req-9ca516ed-8663-4b56-ad54-b1d9f79cfbe6 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:36.869326 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49f19650-35d6-45b2-bb95-b5dd57699db4 req-9ca516ed-8663-4b56-ad54-b1d9f79cfbe6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:36.869782 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-49f19650-35d6-45b2-bb95-b5dd57699db4 req-9ca516ed-8663-4b56-ad54-b1d9f79cfbe6 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:36.881270 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-49f19650-35d6-45b2-bb95-b5dd57699db4 req-9ca516ed-8663-4b56-ad54-b1d9f79cfbe6 service nova] Creating event network-changed:f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98 for instance 500750aa-c8f0-4325-bab4-2585d3b9f567 on hv-cinder-85426 Aug 24 06:01:36.887743 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-49f19650-35d6-45b2-bb95-b5dd57699db4 req-9ca516ed-8663-4b56-ad54-b1d9f79cfbe6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032132 Aug 24 06:01:36.888335 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 585/1216] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:36.890986 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Going to try to terminate instance {{(pid=127194) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:01:36.977920 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-16324af7-8dd2-4ef0-9ca1-b02a53ae5967 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "DELETE /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 204 len: 0 microversion: 2.1 time: 0.130567 Aug 24 06:01:36.981479 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 632/1217] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 06:01:36 2022] DELETE /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:01:36.992249 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:36.993906 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:37.000721 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:37.001231 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:37.001691 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:37.002414 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:37.002885 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:37.003301 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:37.145128 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.policy [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127193) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:37.153642 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-3cb7ff53-f714-45d0-b4cd-8d70be0b16a1 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1577 microversion: 2.1 time: 0.170193 Aug 24 06:01:37.154206 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 586/1218] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:36 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:38.174890 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:38.175587 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:38.183659 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:38.184144 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:38.184578 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:38.185276 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:38.185761 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:38.186183 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:38.323689 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:38.331863 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-5a14645c-bc12-4ccd-80c6-a659109ac5dc tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1577 microversion: 2.1 time: 0.161115 Aug 24 06:01:38.332644 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 633/1219] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:38 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:39.274165 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [req-07e536ae-63dc-4729-b5ef-324ca3cf7591 req-ed0ee074-4744-448f-acd9-567ddc46fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500750aa-c8f0-4325-bab4-2585d3b9f567", "name": "network-vif-deleted", "tag": "f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98"}]} {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:01:39.285310 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-07e536ae-63dc-4729-b5ef-324ca3cf7591 req-ed0ee074-4744-448f-acd9-567ddc46fa93 service nova] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:39.285823 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-07e536ae-63dc-4729-b5ef-324ca3cf7591 req-ed0ee074-4744-448f-acd9-567ddc46fa93 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:39.286257 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [req-07e536ae-63dc-4729-b5ef-324ca3cf7591 req-ed0ee074-4744-448f-acd9-567ddc46fa93 service nova] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:39.297716 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.compute.server_external_events [req-07e536ae-63dc-4729-b5ef-324ca3cf7591 req-ed0ee074-4744-448f-acd9-567ddc46fa93 service nova] Creating event network-vif-deleted:f19fcdaf-09a1-4ab7-b4c7-7c8d52cbfe98 for instance 500750aa-c8f0-4325-bab4-2585d3b9f567 on hv-cinder-85426 Aug 24 06:01:39.303163 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [req-07e536ae-63dc-4729-b5ef-324ca3cf7591 req-ed0ee074-4744-448f-acd9-567ddc46fa93 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 Aug 24 06:01:39.303900 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 587/1220] 10.222.0.73 () {64 vars in 1317 bytes} [Wed Aug 24 06:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:01:39.352391 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:39.353050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:39.359682 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:39.360118 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:39.360553 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:39.361251 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:39.361732 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:39.362161 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:39.427848 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.policy [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389ae44e6cfd4f5fbe56063e5b0ae787', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76656ddf3c744ba1a32cfaa37e278ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127194) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:01:39.436028 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-adfb8efc-eaa1-4b2b-b301-2beed54d6070 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 200 len: 1225 microversion: 2.1 time: 0.087404 Aug 24 06:01:39.436597 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 634/1221] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:39 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:01:40.458779 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:40.459478 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 500750aa-c8f0-4325-bab4-2585d3b9f567] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:40.465824 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.466305 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.466740 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.467434 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.467889 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.468315 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.481494 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] HTTP exception thrown: Instance 500750aa-c8f0-4325-bab4-2585d3b9f567 could not be found. Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Request method failure captured: Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 HTTP/1.1 Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBb0uTnNt08fTbeeJ_sCI8cAv43Byd61smmsZPE7zk79ymndz4dDY5PU-d5tsUuabo-Qe77JpflDcVzmIf9IORl0sUDOepG8w8hbXLzDSBA22PIqwqao7297eCoEEk4mP0e_nbaIKitddbCD-6S21oLG0ptSWSTSPd6fy34EE5R3fkkk Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 06:01:40.483115 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 389ae44e6cfd4f5fbe56063e5b0ae787 Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 500750aa-c8f0-4325-bab4-2585d3b9f567 could not be found. Aug 24 06:01:40.485176 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '500750aa-c8f0-4325-bab4-2585d3b9f567'} Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500750aa-c8f0-4325-bab4-2585d3b9f567 could not be found. Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:01:40.486088 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500750aa-c8f0-4325-bab4-2585d3b9f567 could not be found. Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500750aa-c8f0-4325-bab4-2585d3b9f567 could not be found. Aug 24 06:01:40.487610 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.489043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Returning 404 to user: Instance 500750aa-c8f0-4325-bab4-2585d3b9f567 could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:01:40.489043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-dcfceb23-e834-492b-9d78-7ec1b53de8e3 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567" status: 404 len: 111 microversion: 2.1 time: 0.030869 Aug 24 06:01:40.489043 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 588/1222] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:40 2022] GET /compute/v2.1/servers/500750aa-c8f0-4325-bab4-2585d3b9f567 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:01:40.922253 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:40.922777 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.compute.api [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127194) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:40.929152 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.929661 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.930086 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.930762 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.931206 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.931620 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG oslo_concurrency.lockutils [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.944875 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.wsgi [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] HTTP exception thrown: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Request method failure captured: Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: request: DELETE /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a HTTP/1.1 Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept: application/json Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Accept-Encoding: identity Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Connection: close Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Length: 0 Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Content-Type: application/json Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Host: 10.222.0.73 Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Openstack-System-Scope: None Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: User-Agent: python-urllib3/1.26.11 Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Auth-Token: gAAAAABjBb0uTnNt08fTbeeJ_sCI8cAv43Byd61smmsZPE7zk79ymndz4dDY5PU-d5tsUuabo-Qe77JpflDcVzmIf9IORl0sUDOepG8w8hbXLzDSBA22PIqwqao7297eCoEEk4mP0e_nbaIKitddbCD-6S21oLG0ptSWSTSPd6fy34EE5R3fkkk Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Id: None Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Domain-Name: None Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Identity-Status: Confirmed Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Is-Admin-Project: True Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Id: default Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Domain-Name: Default Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Project-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Role: member,reader Aug 24 06:01:40.946544 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Roles: member,reader Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-Tenant-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Id: default Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Domain-Name: Default Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Id: 389ae44e6cfd4f5fbe56063e5b0ae787 Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: X-User-Name: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: method: > Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: exception: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.948288 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: action_args: {'id': '4556e949-3ebd-4453-9406-907389fb9d6a'} Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:01:40.949146 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.950564 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.951984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Returning 404 to user: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. {{(pid=127194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:01:40.951984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-0de23dbd-0fed-4eea-96ee-2d646c9e2c25 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "DELETE /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 404 len: 111 microversion: 2.1 time: 0.029519 Aug 24 06:01:40.951984 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 635/1223] 10.222.0.73 () {58 vars in 1239 bytes} [Wed Aug 24 06:01:40 2022] DELETE /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:01:40.956613 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '>' {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:40.957221 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.compute.api [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] [instance: 4556e949-3ebd-4453-9406-907389fb9d6a] Fetching instance by UUID {{(pid=127193) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:01:40.963756 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.964232 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.964927 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.965357 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Acquiring lock "96507276-ed40-4723-bde2-cb864799ff28" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:01:40.965833 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:01:40.966257 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG oslo_concurrency.lockutils [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Lock "96507276-ed40-4723-bde2-cb864799ff28" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127193) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:01:40.980308 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.wsgi [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] HTTP exception thrown: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Request method failure captured: Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: request: GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a HTTP/1.1 Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept: application/json Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Accept-Encoding: identity Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Connection: close Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Length: 0 Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Content-Type: application/json Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Host: 10.222.0.73 Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Openstack-System-Scope: None Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: User-Agent: python-urllib3/1.26.11 Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Auth-Token: gAAAAABjBb0uTnNt08fTbeeJ_sCI8cAv43Byd61smmsZPE7zk79ymndz4dDY5PU-d5tsUuabo-Qe77JpflDcVzmIf9IORl0sUDOepG8w8hbXLzDSBA22PIqwqao7297eCoEEk4mP0e_nbaIKitddbCD-6S21oLG0ptSWSTSPd6fy34EE5R3fkkk Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Id: None Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Domain-Name: None Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Identity-Status: Confirmed Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Is-Admin-Project: True Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Id: default Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Domain-Name: Default Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Project-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Role: member,reader Aug 24 06:01:40.981834 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Roles: member,reader Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.73:8080", "publicURL": "http://10.222.0.73:8080/v1/AUTH_76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/volume/v3/76656ddf3c744ba1a32cfaa37e278ef2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.73/identity"}]}] Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Id: 76656ddf3c744ba1a32cfaa37e278ef2 Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-Tenant-Name: tempest-TestVolumeBootPattern-970304747 Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Id: default Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Domain-Name: Default Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Id: 389ae44e6cfd4f5fbe56063e5b0ae787 Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: X-User-Name: tempest-TestVolumeBootPattern-970304747-project Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: method: > Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: exception: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.983890 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: action_args: {'id': '4556e949-3ebd-4453-9406-907389fb9d6a'} Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: {{(pid=127193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:01:40.984780 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. Aug 24 06:01:40.986391 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: ERROR nova.api.openstack.wsgi Aug 24 06:01:40.987952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: DEBUG nova.api.openstack.wsgi [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Returning 404 to user: Instance 4556e949-3ebd-4453-9406-907389fb9d6a could not be found. {{(pid=127193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:01:40.987952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO nova.api.openstack.requestlog [None req-ed76487b-2fea-462a-a92e-363e5798e119 tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a" status: 404 len: 111 microversion: 2.1 time: 0.030384 Aug 24 06:01:40.987952 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: [pid: 127193|app: 0|req: 589/1224] 10.222.0.73 () {58 vars in 1236 bytes} [Wed Aug 24 06:01:40 2022] GET /compute/v2.1/servers/4556e949-3ebd-4453-9406-907389fb9d6a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:01:42.271266 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: DEBUG nova.api.openstack.wsgi [None req-e2614e1b-ca1c-4da0-908c-dce1e972b72a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] Calling method '.version_select at 0x7fa91c23a790>' {{(pid=127194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:01:42.295006 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO nova.api.openstack.requestlog [None req-e2614e1b-ca1c-4da0-908c-dce1e972b72a tempest-TestVolumeBootPattern-970304747 tempest-TestVolumeBootPattern-970304747-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1214081369" status: 202 len: 0 microversion: 2.1 time: 0.027486 Aug 24 06:01:42.295792 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: [pid: 127194|app: 0|req: 636/1225] 10.222.0.73 () {58 vars in 1263 bytes} [Wed Aug 24 06:01:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1214081369 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:02:47.068350 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:02:47.069050 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Wed Aug 24 06:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:04:04.396048 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:04.396694 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 06:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:04:20.388397 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:20.388876 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Wed Aug 24 06:04:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:04:26.116279 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:26.117014 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 06:04:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:04:51.820209 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:51.820829 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Wed Aug 24 06:04:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:04:52.491274 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:04:52.491870 dv-cinder-854268-1-iscsi devstack@n-api.service[127193]: Wed Aug 24 06:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:06:07.077015 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:06:07.077658 dv-cinder-854268-1-iscsi devstack@n-api.service[127194]: Wed Aug 24 06:06:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!